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Foreword 



The National Right to Read Ofhce wilhin the U,5, Office 
of Education (USOE; has the responsibility of ndministenng 
Title VII (The National Reading Improvement Program) of 
PubKc Law 9^380 i\s amended by Public Law 94^194. In 
Public Law 94-194, d congressional charge is given to the 
Commissioner of Education "to carry out/ either directly or 
through grants or a»ntracts: 

1. Innovation And development projects and activities of 
national signifuance whtch wdl show promise of hav- 
ing a substantiiil impact in overcoming reading defi- 
ciencies in children, youth/ and adults through 
incorporation into ongoing state and locaJ LvJucatiociaJ 
systems throughout the Nation, and 

2, Dissemination ijf information related to buch pro- 
grams," 

After %carefuJ review of the "research to classroom prac- 
tice" type of efforts/ the Basic Skills Program Office deter 
mined that the most effective vehicJe for moving research 
into classroom practice is the classroom teacher. Classroom 
teachers must be guided into solving fheirown instructional 
problems/ utilizing a systematic process. The turn-around 
time for classroom improvement itl * be short if it is to be 
of use to the students cunently needing assistance 

To thb end/ Dr, Alvin Loving, then serving as a Right 
to Read technical assistant and 1, 3s Program P^velopment 
Branch Chief/ organized a steering committee in December 
1-4/ 1975/ Jo examine the problem and a solution. 



' Right to Read Premises 

Every'teacher of reading must be the catalyst for effective 
teaming of all children in that classroom. 

Individualized and group instruction which use problem- 
solving techniques to find effective methods and materials 
must become a part of the teaching style of every teacher 
The target of effective instruction should be children who 
are reading at grade level- The grade level norm could be 
based on nMtonal testing norms or. criterion-referenced 
norms developed by the teacher or system reading staff. 
If the child learns to read effectively as indicated by eith^*r 
of the two meaSL'rementS/ success has been achieved. 

The Steering Committee agreed that: 

(1) the focus of the problem-solving model should be on 
teaching practice as contrasted with reading theory 
or tradition, 

(2) the crux of the problems of ineffective reaSers is as- 
sociated with the nature of the reading instruction 
children receive. 



(3) more effort should be directed to aiding theclassroom 
teacher in his/her effort to teach reading 

(4) reading for ali children should be targeted at grade 
J eve I achievement 

(5) problems dealing with instruction4tleffcctlveness and 
management should become the focus of attention 
of any problem- solving model, 

(6) teachers should be guided in assessing systematically 
the impact of specific materials and methods with 
different kinds of children. 

The Basic SkiJJs P>x>gram Of/ice accepted these conclu 
sions and based on them and Right to Read's program 
rationale/ had a model developed with accompanying in- 
struments to etiable the reading teacher to resolve his.'her 
problems by: 

1, identifying the problem, 

2, assessing pupils and developirtg a diagnostic profile. 

3, selectmg from possible solutions th^sL^ be;t suited lo 
the students' needs, 

4, implementing and analyzing the re^yults ^nd their ef 
fed oil student achievement. 

The model provides a procedural outline for conducting 
active classroom problem-solving in rt.'ading. It ^'presents 
the fir&f concentrated attempt to get cJassruum teachers to 
examine the effectiveness of their instruitional praLtn.es m 
a systematic manner 

Shirley A. Jockson 
BaSK ShUsi Dtrcctor 
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Introduction 



In jccent years, the public bchoolb have been character 
jzed by changi^ and innovation rebulhng from ^.hanging 
demographic factors, neiv curncuJar offenngb, and vaned 
inbtrucoonal methods and technology. Even though much 
of thib change was mtended io exert a positive influen^:e 
on student perfoimance and attitudes^ the schools have 
experienced a steady decline in measured achievement per- * 
formance for many of the nation^ children. This situation 
has encouraged a persistent search for solutions that will 
aid in the reduction of these negative trends. One $uch 
solution treatb inbtructionat methods as a major influence 
on 'he achievement performance of children. Our efforts 
here will pursue aspecl^ of inbtructional method necessary 
for efficient and effective learning, - 

Any mbtructional method must provide teachers Vkith 
skills to use new materials and techniques for selected chil- 
dren expcnencing different Kinds of circumbtanc(?b In ordtr 
to employ new materials and techniques, teachers must 
learn to make appropriate selection and to execute com- 
petently. Many teachers have never been provided wuU 
speafic training that enables them to develop and impEant 
strategies for sele-.tin/ and usiftg instructional resources 
effectively. 

In the area of reading, the selection and execution prwb- 
I(?m tak^s on special significance because of the' vast array 
of materials and approaches that hdve to be chosen and 
matched with different learners. Teachers are asked to eval- 
uate pnnt and nonpnnt materials such as ivcrkbooks* prac 
tice exercises, film&tnps, textbooks, slides, and tapes dealing 
with vanous aspects of the reading program. In addition^ 
teachers are expected to employ different appruaches such 
as individualized reading instruction^ learning stations, 
peer tutoring, and skill development technit^i^es for chil- 
dren with different abilities, needs and support resources. 
U becomes apparent .hat - - - the problem ive face is h^'v^ 
to fosttr better sele tion of matenals for use m executiag 
reading mstruction To accomplish this, more attention 
must be direct(?d toward systematic approaclK's to problem 
identification, probii m analysis, applicatu^n of treatments 
and resource utilization. The mastery of these ctpproa^hes 
can lead to a process of problem solving that utilizes rele- 
vant resources for meeting the needs of reading teachers 
and learnej^ alike* Opporturaties to learn problem solving 
and data utilization procc\sses should provide teachers with 
a workable pattern for planning, manaf ng and evaluatm)^ 
learning expenences more efficiently and effectively . 

To assist reading teachers m data utilization and prublein 
solving^ we have developed this model to present the read 
ing teacher With the necessary technical and practical com- 
ponents required for successful selection and execution of 



instructional (?xp(?riences in reading. We decided to name 
the model independent Classroom problem Solving (1CI*S) 
to reflect the actlV1^ that teachers will b(? doing. 

The ICPS Model is intended to aid reading teachers in 
the development of competencies _i the 

1, Identification and definition of a problem area. 

2, Selection of a speafic problem for study, 

3, Selection of a working hypothesis or prediction that 
guides the problem solving processes, 

4, Careful recording of action taken, 

5, Analysis of evidence regarding relations betv^een acbons 
and desired objectives, 

6, Pursuit of an insiructional procedure based on speafic 
data genetated on the children to be taught, * 

7, Accumulation and summary of evidence gained from 
instruction, 

S, Continuous evaluation and retesting of actions pursued 
in instruction. 

In order to aid teachers in the learning and practice of 
these problem -solving steps^ the model was employed lo 
iraegrate the steps and focus them on specific problems in 
the teaching of reading. Such a model must enable reading 
teachers to handle and understand each step individtially 
and to assess their impact and value on practice outcomes 
collectively. The model employed should help reading 
teachers to understand both the nature of the instructional 
process and the resulting changes in the achievement pat- 
tern of those being taught The model must also emerge 
ds a viable approach for understanding the nature and ef- 
fects of teaching practice across a variety of content areas 
and environmental setting^. 

When considering the development ofair^odel that helps 
reading teachers solve classroom instructional problems* 
one should attempt to elicit the views of other professional 
educators with differing experience backgrounds. The sys 
tematic and organized approach to problem-solving pro- 
vides a common communication mode for professional ed 
tjcators to share practice and intellectual experiences 
Without such a cX}mmon means for comparing the results 
of instructional ap^ 'oachs across a variety o5 environmental 
conditions, impn^v d ^^ractice resulting from classroom 
teaching is unlikely to occur to the extent that it makes a 
difference. Therefore, the model is likely to evolve and 
change as practitioners from around the country provide 
feedback on the actual effects of the model when employed 
in classrooms under different condition? St is crucial to the 
meaningful improvement of the model that information 
coiKerning its use be incorporated into the formal pres 
entatiort for widespread adoption 

1 



ERIC 



f 



t 



The intent of tht^niudel ib to use a Mt'p-b>-^lep ap]^u<iLh 
to hdp reaiJing teadiers solve problems in roading inMrUL- 
tion. As a result of thi^ experience we expert tea(.herb to 
be able to employ a systematic prott*b^ for making key 
d<?cisions involving instructional prattuf Our proi^edurt- 
should enable teachers to apply key dements of the sci- 
entific method as an approach to pn>blfm M>'\ing and for- 
mulation of practice apphcatiifns or the ri'porting vf 
results to others with similar problem^. Fhc gonoral pur- 
pose of this modd will be achieved if it will help teachers 
in thetr efforts to identify and isolate problems, dt'Mhe j 
plan for approaching the problem &ybtemain.ally, Lollui.t 
and interpret relevant data, design reasonable activities and 
procedures for implementing a solution based on ifemrd 
results, evaluate the performance 4if partuipani^ , . . and 
evaluate the effectiveness of the instructional and problem^ 
solving processes employt?d^ As tea^her^ arc provided w ith 
systematic practice in the use of this model, it is expected 
that they will adopt and adapt a realistic syMematic prine^^ 
for guiding their instructional practice in reading. While the 
instructional area of fo^us i^ reading, thi^ model is not lim- 
ited to finding solutions to problems in the reading area 
only. Any subject matter area at any grade level can be the 
focus of the ICPS ModeL The ICPS Model can be employed 
to deal with problems associated wjth^ learning content 
information, use of reference materials, attitudes toward 
others and self, attitudes toward learning, comprehension 
in the content areas, special characteristics of subject mat- 
ter, approaches to teaching subject matter concepts, effc^cts 
of organizational patterns on learning outcomes, effects of 
different types of instructional media on learning, and the 
influei ceof demogranhicseciors on learning subject matter 
in a variety of setting^. In short the ICPS Model can be 
employed to find reasor^ble solutions to most instructional 
problems encountered by classroom teachers. 

To acNeve the purposes outlined earlier, the develop- 
ment of a problem solving model is essential so thjt teach- 
ers can solve instructional problems and iTiprove tcwhing 
practice. This procesj> is Imcti on i/ic prantbC that mpwocmait 
tn student aduevetiteni 13 ihi' direct rcsuU of impromi l«7i./»«x 
practice^ md improvement in ieadttn^ practice rs a personal and 
individual process that rs the end ftrodnct of self-evalttatton. and 
front our point of view, self-evaluation thai leads to tnstructionat 
mprovenietit is f/u* end product of a sy>/*"^««i/it protein* of proifletii- 
solving. Therefore, any attempt to improve teaching practice 
must provide a means for teachers to do systematic self- 
evaluation in the context of the activity they want to im-^ 
prove. It is this notion that shapes the s^tcific objectives 
that will guide the continued development and implemen- 
tation of ICPS. 

Before there is a statement of specific objectives, it is 
necessary to indicate some of the beliefs that pmvide the 
tiasic foundation of our approach to building and unng the 
model These beliefs are: 

L The focus of the model is on teaching practice as cou- 
trasted with reading Ihcory or tradition. 
2. The crux of the problems of most irK'ffective readers is 
associated with the nature of the reading instruction chtl- 
dren are receiving. In order to effectively improve the read- 
ing instruction, the children's strengths and needs mu^t be 



assessed, a program to mc^et these needs mu&l be imple 
mented, and the effects of the tr<.Mtment evaluated 

3. More effort should be directed toward aiding the class- 
room teachers in their efforts to teach reading. t*i improve 
instructional methods, <ind to establish selection criteria for 
evaluating the program's effectiveness 

4. I'here 1^ an achievement level in reading most children 
should be expected to reach in judging »\hether the pro 
gram implemented is effective for instance, the expccta 
tion or cnterion of program suaesis may Iv that all children 
make one year's progress m reading as measured by a par- 
ticular test or achieve some measurable standard of per 
for ma nee. 

5. This criterion for instructional effectiveness and man 
agyment should become the focus of an> effort to improve 
rtadingachievemen* If the cnterion is not being met, it is 
important to establish the cause of tht* pr>blem 

6. Teachers should select and utilize specific matenals and 
methods for different kin^,' f children with different types 
of learning problems^ Thi. ctionand use should bebtised 
on observed outcomes resulting from teaching practice 

Some methods that can be used to deal with pn^blem 
solving are: 



Probkiff 



Materials 



Method 



Motivation 



Placement of 
the children 



Children not 
following in- 
struct tons 4C' 
curatelj 



A numbc*r of differerii 
pmgrammed lc»ssons. 
Independent Aclivilv 

paCfceis. 

Standard i/(>d Dtagn^^^ 
tic Reading Test 
Informal Assessment 
Prt>a»diiri's 



Tests for determining. 
<!> ability to foiloiv in- 
structions, {2} krvml 
c^geof cocabulan usc\] 
and ability tc^ follow 
ivritten directions 



Cive children more 
( hcHcvs 111 sett'cting the 
activitKft they tsould 
like to do. 

Usi^ thfs test fvr chii 
drc'n achieving MvtW 
tlie avt^rage abthty be* 
cause ihis test is de- 
signed to assess specific 
skill abilities for'se- 
lecied groups jccu- 
rately. 

Try vabd ir^itruction, 
wntten insiructiim and 
^ ^cff^btnaticfn ^jf the 
tv%o to find ivhich is 
more e^fc'ctrve in ini- 
proving chitdrt>n'j;abil- 
iiy to follcfw in- 
structions. 



It should be apparent that our understanding and Lu*liefs 
will have a significant influence on the slatenwni of specific 
objectives, the methods of developing the model, the set- 
tings for testing the model, and the evaluation of the worth 
of the model for improving practice 

The specific objectives of the ICPS Model an* 
L To help teachers devek>p a procedure for identifying the 
instructional problems influerKing achieeenient. 

2. To help teacherssclect, collect and organize data required 
to implement the ICPS Model , 

3. To help teachers analyze data and intcrpan findinj^s 

4. To help teachers select solutions based cm available dala^ 

5. To help teachers apply data vvitliiti the context of class- 
room instrumentation. 



6, To help teachers deiemiine the kind^ \yi JcUd they have 
on hand and the best method for inferprefir^ and using 
the data for instructional purposes, 
7_ To help teachers evaluate the model's effectivenej» for 
solving instnictional probtemb by determining w h^t mbj^^ht 
they have gained by use of the problem -solving model. 

8, To help teachers analyze the realities of the cbssroom 
and become more aware of how these realities affect tedch 
ing practices. This will be accomplished through the use of 
the Classroom Data Profile Sheet chart method which vv ill 
help the teacher construct a ddtii profile of each child and 
discover trends and relationshif^etween a group of traits, 
skilfs or backgrounds of children in a gi\ en classroom 

9, To help the teachers conduct a systematic study of the 
instructional process of redding by providing an outline uf 
specific procedures that can be employed to evaluate the 
effects of different-instructional methods. 

10, To help teachers determine how implementation pat- 
terns might vary across vario^ pi?ob!em situations by de- 
termining which children benefit most from whaf kind of 
instructional approach, 

11, To evaluate the effectiveness of the model * 

Questions Most Often Asked, by Teachers 
about The ICPS Model 

Rationale > 

''l^ What is the ICPS? 
ICPS stands for Independent Classroom Pj^bl em-Solving 
It is a self help model for reading te.ichers The purj.>om*<> 
of the model are three/old, 

• To introduce ^nd teach reading teachers a *;ystvmatic 
problem-solving process, 

• To help reading teachers improv e their instructional prac- 
tice by the use of a systematic problem-solving process, 

• To teach them how to select, collect and report data nA- 
evant to their instructional needs in reading 

2p Who can use this model? 

The model is designed to be ubcd b) classroom teachers 
w ith access to their studer^s aehtevcmeru ^ore^ It can K 
' used by teachers of any level, teaching any subject 
3. In what situation should this model be used? 
It IS best utilized to help a teacher look at relationships 
between different scores that represent performance and 
charactenstics that represent expected student behavior 
4- What are the berwfits accrued by using this model? 
The users are provided with an approach to probK ,i 
ing. The lCf*S Model helps them approach inbtructtona) 
problems more systematically- With practice the teachers 
can develop a problem -solving mind set, refining their ob 
ser^tonal skills to that they can pick out the relevant var- 
iables to look at In any problem situation 
5, Does the complete model have to be implemented? 
No, after becoming familiar with the different parts of this 
problem-solving methoil, the teachers are encouraged to 
use the steps of the process most useful to them Once the 
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problem-solving mind bet cbtabhbhed man) uf the stcp^ 
can be modified or skipped entirely 
In fact, the first step (formulating the problem) is the key 
step, Ofkti the iiotiilwn of tiw pmbttm i> iontiUticd m Uk im^iKT 
^iakmcnt of tht prohiitn It i^ in the statement uf fhv probli m 
that the relevant variables of the problem and their rcla 
tionships become evident, 

6, Do I have to read the i^hole manual from cover to cover 
to learn this problem-solving technique? 

No, you ma) already have m.in> of the bkillb needed to 
cumplete the problem -bolv ing method, Rcftr to Step^ m 
the Probk'm Solv ing Proi^edurc' jn Step 8 to determirn; 
vvhich ^tepb you have already accomplished ^^nd Ahich 
steps you will need mure information to complete. Thtrn 
go directly to those steps. It might be helpful tu c\jvcrthe 
entire manual to make sure something important is not 
being left out, 

7, What kind of problems is this problem-solving method 
used for? 

This method is used in determing the relationships between 
or among different charactenstics. abilities and skills aS 
measured by test scores. It can be used to help teachers to 
compare the effectiveness of various teaching techniques 
. as measured by achievement tests. The method can also be 
used to determine which of tjie various charactenstics arc' 
associated with various skills or abilities, 

8, What l^nd of problems can not be answered with this* 
method? 

Questions which are so general that there are several parts 
to the questions and which have more ttian two or three 
vanables involved cannot be answered using this method 
unless each speafic part and two variables can be isolated 
and the question broken down into component parts. 
Another type of question which may not be answerable is 
one wherein the variables cannot be measured. The infor- 
mation needed mubt be quant]fta^[cyfiD^i^t'T to use thib 
problem-solving model, [ 

A third type of question which is unanswernj^ble using 
this probIem-s\>lving method ts one tKit calls for v alue judg- 
ments. This method simply allows teachers to generate, 
expand and organize factual information wtih ivhich 
make thejudgments concerning instructional practices 

9, Is the ICPS Model designed to develop new theories 
or to help teachers m practice? 

AlthiTUgh the results of these studies may add io existing 
theory, the mam emphabis uf the ICPS Model (b tvt help 
teachers tmprov e instruction m Reading. 

10, How long will it take to complete a project? 

A project can be completed in aS:h>ut t^vo vveek^, Tliu 
amount of time used is dependent upv>n the kinds ot ^jucs 
tions guiding the project, 

11, What is the procedure for using the problem-solving 
method in the ICPS Model? 

Step 1: The problem is identified. I his entails formulating 
a quebtion and determining if answering U will bt worth 
while. 

Step 2, The hvpothcbii^ is formulated. A decision v>n km 
to measure variables iS madvv 

3 



step 3: The Chirac tens tiC!] of the test p^puJati^n arc <iL'- 

fmed. ^ — ^ 

Step 4; Methods of samphng are descnbi^l. 
Step 5: A study design is selected. 
Step 6: AU procedures are liMed. 

Step 7! Data is processed. Information and scores arc 
charted. The statir;Hcal analysis mostappropriatetu the data 
is determined anU the results calculated 
Step S: From the rcsultS/ problem- sol vtpg decisions are 
made. The answer to these questions should bedeteTmined 
Wi!s the hypothesis sttpporled'' 

b. h there a signiftcani difference^ 

c. is tht-re a signifiaifit rclatiottsiup'^ 

d. Vihat was the answer to tny qncstions? 
Was Ute problem $oived? ' 

On the basis of the answers to^. 
of action. 



r decide the next a^/se 



Defining the Problem 

12, How does one formulate ajneasurable problem? 
The requirements of a problem- solving question are 
L The problem be of manageable size (i <^ r it does not 

lead the teacher into excess expenditures of time, re- 

sourcesy and commitrrfents). 

2, The question must be concrete and explicit (i e , what 
is being questioned and who is involved in the ques- 
tions must be answered). 

3. The question must be measurab 
In order to formulate a measurable duestiony the problem 



echniques which are 



solver must be aware of the differcnt 
available to test the implications of the hypothesis, 
13- What kind of test should be used to measure the var- 
iables? / 
First, the vanables {i.e.y the characteristics or performance) 
must be isolated. Then^ the test best suited to measuring 
that trait for the particular age gioup of the study must be 
found. Most tests^ test characteristics and test publishii>g 
companies are listed in Mental Measurement Yearbook by 
Buros, Teachers can also develop tests for'the vanablesy 
though it is more difficult to esUblish a valid and reliable 
test than to utilize a published test already in use 



Selecting a Design 

14. Given a specific problem, how should osi/ go about 
designij[ig a study? ^ 

After defining the problem, it mu&l be matched with a ge 
nenc problem typt* and that format should be foltov^ed 
The number of subjects in a group, whether there is a pre 
teM or a post-te^ty and what method wasi used for selecting 
subject!]^ all affect the desiign i^ele^tion Consult "Statistical 
Model Study Desigiis" m Step 5 which refer to the mobl 
appropriate statistical model in Appendix 1 

15. What arc experimental and control groups? 

These are the groups that arc formed when twu or mi^re 
different treatments wiJi be given. The experimental group 



will retetve the special treatment aj J Va^ control ^ruup will 
receive jthe normal treatment, so as to ensure that changes 
in the relevant char^Kterishcb aren't due to other \ariables 



Processing the Data 

16. What knowledge of statistJOi is needed in order to 
interpret the data? 

All essential mformatjon i!> provided m the manual. 
determine which statistical equation will be needed for thc 
problemy consult Step 5, Appendices I and 2. The proce- 
dure for ranking scores is a prerequisite to many statistical 
equation&y and is shown in Step 7. 



Results 

17. What can be done with the results of the study? 
Depending on the rcsults and type of problem solved, the 
results can be used to: make the teacher more sensitive to 
relationships of certain traits and abilities, provide decibion^ 
makers with evidence siupporting needed change;], share 
the results with other teachers, make decisions about con- 
tinuing present curricular practicesy adding 'o ity or ^ hang- 
ing it completely^ and add to existing theory. 
IS, Which stud^s will go into thefnanual and why? 
The studies which are most useful to other teachersy or 
which have a unique emphasis will be used in the manual- 



Evaluation 

19. What are the limitations of the model? 

The most obvious limitations are the time constraints and 

the fact that some rcsults may not t(e generalizable. 



The ICPS Model \ 

The Independent Classroom Problem Solving (ICPS) 
Model will be presented in steps that can be studied and 
used independently or in concert with other steps. It is 
important for the user to understand each step so that the 
relationship between the steps are useful and meaningful 
The practice activities are designed to reinforce elements 
of each step while focusing attention on how each step 
contributes to the total process of problem-solving. ♦ The 
first step in the ICPS Model is thij identification of the 
problem. Problem jdentifiuition injudeb formulating and 
evaluating thequesitions to be answeied. ^ The bccondf sitep 
IS concerned with determining the hypothebib to be tested 
Tbi±> Mep also eOtaib t^hoOMng the be±>t alternative Violation 
and deciding how tu measiure the \ariable!] selected for 
study, ^ The third step involvLiv a careful definition and 
recording of relevant characteristics of students or subjects. 
♦ The fourth step lisls tvpes of sampling procedures ♦ In 
the fifth step a study design is selected ♦ The sixth step 



er|c 



in 



r^uire^ the outtme and listing of all procedures employed 
in the study. • Collt'ctjng. processing and interpreting the 
data comprise the seventh step. Decisions and analysts of 
the data are made at this point, • Step eight determines 
whether the hypothesis was supported or not. and gives 
plans for the next course of action. 

Personal Questions Concerning ICPS Model; 

'< \. 

4. 

5. ^ 



NOTES: 



The Inoepend^ht Classroom Problenf Sfolving Model 



Reading Theory 
Research Findings 
Readlog Practice ^ 
Reading Methods 

Designing Materlak and Instrjuctlonal Procedures 
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StepZ 



Defining the Problem 
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Step 8 
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' Instructional 
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Step? 



processing the Data 
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Step 6 
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:^ 

Step S 
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step x: 
The Question 




Formuiation of tlie Problem 



'^Th purpose of probiettt^tdvm^ is to tUscoi>er anSt^-^r^ to qu^hons 
through the appih^atiott of sCKntifk processes. To he ans^oeraHe by probkm^ 
solvm^, tjttfstmti^i tttuiit tur u^h'ti m sttth ti n\ty that extn'rtntentoUon or 
olisen'atiott m ttjCT^trorhi mil yjcfrf the nattett tnformatinn ScivtUiUc 
tpiCStionS. of (VrvfSf. tire^yt^lujpimzarfi itr sfttVWv ^^ikvukUi^t^ Thvy m' 
promptvii b}f rcPvcUmis oti the rehtumshtii^^ of tUfferCtit Umt*^^ ami mfiu^ 
ettccs (js ii*e krtOW them Probton-solvm^ prtk\^se< altim* us fo test our ^ 

huucbes d\iut hoiv a'rtttut fon'esatuJ mfiucmcs affect miv another (P 2^, ; ^ 

Barium) * \ 



The rcquircmonb of a problem -solving question are. U) 
ihat the problems be manageable bize, {^t\\ is/ it bhould 
not lead the teacher into expenditures of time, lesources. 
and commitments/ (2) the question must be concrete and 
explicit. It must clarify who Is involved in the question, 
what is to be determined, and why it Is signlhcani; (3) the^ 
question mubt be measurable, and the results must b^quan- 
tifiable term^, symbols, determinations, or expressions of 
/facts rather than values, inferences, or suppositions The 
following exemplifies a good problem-solving question "Is 
oral presentation more euective than written presentation 
in improving students' performance on tests within a class- 
room?" ^ ^ 

This problem is manageable in several ways. First, it 
would it^volve'a simple comparison between two types of 
instruction, both of which the teacher uses or has used in 
his/her classroom instruction. The teacher has all ne(.'?ssaTy 
resources available to answer the question (S)he has the 
subjects, her/his class, and her/his ov\'n instructional tech- 
niques to use. Little commitment is involved except the 
decision as to when to b^gin the study and when to end 
it, in other words, how long the study will last. 

The problem is concrete and expHcii. Those involved are 
the students and their performances on tests, as well as the 
teacher and the two different styles of instruction. What is 
to be determined is whether oral instruction or written in- 
struction is more effective. And finally, the reason the prob* 
^lem is si$^nificant is because one type of instniction versus 
another may improve students performance on test scores. 

The problem is measurable because the results can be 
quantitod in terms of test scores and th^ improvement or 
lack of improvement measured.^ Decisions will have to be 
made as to how the results wiH be measured. For example, 
will the teacher use two groups of students? Will (s)he use 
different academic subjects for different types of instruc- 
tion? Will (s)he use the entire cla.ss and give oral instructions 
for a designated period of time and then give v/ritlen in- 
structions for an equal period of time? Will {s)he use a post* 
lest only or will (s)he use both a pretest and post-test^ 
These decisions will necessarily have to be made to elimi- 
nate items which might make the results unclear; however, 
the problem is measurable, and many of these aforeme^i* 
tioned decisions will beclearer in a given classroom because 
they are logical. 
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In determining whether a question can be answered us- 
ing the problen^i- solving methods the following questions 
must be Answered: 

1. Do you already know whnl the answer ib? 

2. Can the question be an!>werecl by use of a test or other 
quantifiable data? ' ' 

3. Is the question precise enough to direct efforts^ toward 
efficent and effective ways to find meaningful answers? 

4. Does the question filarify what tb to be determined and 
who is involved in the question? 

If you can answer yes to each of the preceding questioi{s 
for a given problem, then the problem is researchable. It 
is the objective of this section to teach the user how to 
identify and define a problem in instruction 

Some iiiustraitite Exantpie^ of Rcmrdmiiie Probfems 
Problem 1. How does the amount o) ttmc :>pettt in tndwi- 

(iuahzcd wstriutton affect rcadtrt^ fK^rfonmuie for sixth grade 

students? 




4 



Activity 1:1 





Following ts a list of problems. Rut <in A m front of e^i.h appropnaU- probkm Put an J in front of uat-h int^ppropnate 

^ * problem. 






h h oral presi-'tttatiotj more effectiye than wntteti prcsetstHtkm in improving student i^^rfontuwu on tests? 






2. h there greater improvement in rahwis^ ^iimprfliaii^tun uht-n an mdu'tduithzai iiifitratih [5 used instead 






of the tradttmtaf r&tdtn^ group approach? 




y 
y 


3. Does hotm^eneouA ahdii^ groupirig pn)duce more positive .ittitudes toward It^aming than does hctcr^ 




O^^ttCOitS ^TOUpStS^? 






4 U \\\f>xf> A r^httnntE^hip t^ptu/ppn ^tf-rotirppt and rfintlittt^ /irhiinmti*^ni> , 


) ■ 




■\ 

5. Wh^t K th** rp:^hnn<;hip tiPtwppn timi lanoiniot* nkilK .ind it^nHrtt hitn^ii.7i^r nhiL .^<^ d^l^rmin'^'f by 






Selected Standardized Test? ^ 








■ * 




, 7. This study <;pplfs In prnup \)\ai nttiiitdf*< r^nsp /W i?radcA 












9 What ^h'^uld J maJ^" "^y mrrirulfntt? 






. 10 /J»*r^rt^v«**«''«' mandate frtf^'^f 


m 




See rtext pa^e for otisttvtA 
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Problem Evaluation 



The answers thai should have been g(ven for activity 1:1 NOTES, 
are as follows: 

\. A 2. A X A 4. A 5. A 
6, 7. / 8. ; 9, / 10, / 

The explanation and evaluation of these answer^ are dis- * 
Cussed further in the paragraphs below. 

The first three questions (1-3) are "applied" problem- 
solving questions; theV were formulated to find a speafic 
way tc/ improve reading instruction. The next three (4-6) 
are more "basic" problem-solving questions in that they 
were formulated for the purpose of learning more about 
spt*cific relationships. Both types of questions ain be useful 
to the reading teacher in solving problems in his/her class- 
room and improving his/her methods of teaching. These 
are examples of good problems because they pinpoint the 
relationship to be studied and observable results can be 
obtained to answer the question asked. 

The last four sample questions (7-10) ait: not examples ' 
of appropriate problem-solving questions, ^4umber 7 is not 
even statt'd as a question. The statement reflects the prob- 
lem-solver's bias and points to the possibility of subjective, 
unscientific interpretation of the results. Questions Sand 
9 could be made researchable by grouping them into 
smaller/ more specific questions. For instancey in question 
3, one particular possible factor could be isolated/ like mo* 
tivation^ and the strength of the relationship between mo* 
tivation and h»gh achievement could be measured. For 
question % two different methods or maWnals could be 
implemented at different times, or with different students 
and the results of the two programs could be compared. 
Numbt-T 10 could not be answered using thi:> problem-solv- 
ing model because it involves value judgment and there is 
no way to test these values. 

Personal questions on the Formulation of a Problem; 

L 
2. 
3. 



10 



ERIC 



16 



AcnvrrY i:2 



Activily 1,2 IS designed lo cishsjI you in clanfvin^ prob^ 
Icms and evaluating them tn rcl^ition to the factors that 
must be considered in formutatinga problem for systematic 
study* 



Practice Activity 

In the chart below^ write the problem area which con- 
cerns yoii then check the appropriate lines beloiv to help 



define if<ittr problem. Tht.n formulutt wtu^f prubkm soi\ in^ 
queMtun and write it belo»\ Murt tkin one letter fiu\ bt 
checked in each section 

Additional Readings 



Easy: Barnes, p, 12, 27; Ferguson, p, I 
Hard; Slakten p, 255 



Area of concern: Time allotment in instruction and reading performance. 
Your area of -concern: 

Cou'dn't 

Det ' 



Yes 



miri 



1, Who was affected by the 
pfoblem? 

a, learner 

b, teacher 

c, group of learners 

d, administrators 

e, parents 

f, other 

s pecif y 



2, What is the nature of the 
problem? 

a. motivation 

b. materials 

c instructional methods 

d. behaviors 

e. methods of teaching 

f. evalua' on 

g. other 



specify . 



3. .Who can bring about necessary 
change? 

a. learner 

b. teacher 

c. ,%^p of learners 

d. fJarents 

e administrators 
other 

specify C 



Couldn't 
Deter- 
Yes mine 



4- What is the goal? 

a, more effective teaching methods 

b. more effective evaluation and 

placement ^ 

c, aiieviaffng inadec|uale 

performance 

d* alleviating inadequate behavior 

e. discovering relationships 

f, other 

specify 

5. Is this problem worthwhile to 
pursue? 

— a. Will the results help me to teach 

better? 

b. Will the results help mr make 

decisions? 
Explain 

Statement of the problem solving question: 
How does the amount of time spent in individualized 
instruction affect reading performance for sixth grade 
students. 

Your personaf stateitient of an jiliequatc i>rof)U'm-Si}Uftn^ t]uc:>- 
Uon. 
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step 23 
Defining the Problem 
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Hypothesis Formulation 



To appJy the scitrntifK method in solving a prubkm one 
must formulate a hypothesis or possible solution to the 
problem. The ht/pothe$is is a tentative profH}$ttton suf*^e$ted as 
a solution toa problem or as an explanation of same ol>s€nfed ^tate 
of affairs. It presents ,a simple statement of the problem* 
solver's expectations relative toa relationship between var- 
iables within the problem. The hypothesis is then tested 
with the aid oi a systematic problem-solving procedure. 
One must decide whether the hypothesis should be based 
on specific theory or predict what the outcome wiJI be from 
surveying current researth or personal experience, 

A hypothesis should consist of a theoretical definition 
and an operational definition of terms and/or concepts. For 
example, a theoretical definition of intelligence might be the ability 
to adapt to one's environmettt, but the operational definition of 
intelligence could be those be^izv'tors that are measured on tite 
Stanford'Binet Test. Having both an operational and theo- 
retical definition has three advantages for the prob? :m'SoU 
ver: (1) interpretation of results will be more realistic; (2) 
the two definitions will support the techniques of obser- 
vation and measurement used; and (3) the problem-solving 
process should be more meaningful, 

A different example is aggressive behavior. A theoretical 
definition could be the intent to injure, hurt^ or destroy. 
In this case, an operational definition is crucial for the term 
"intent" and lo whom it is intended. On the one hand, it 
may be the hitting, kicking, punching, and ve^l insults 
from one child to another. On the other hand^^tnn^iy be 
the same behavior measured in doll play. ObuiousijMtfi op- 
erational definition ts extremely mtimtant for the measltrcment 
of results, whereas a theoretical definition adds more meaning to 
hypothesis. 

In formulating hypotheses, one must look at all avenues 
for testing the statement, choose the most feasible solution 
to the problem, and find the standardized or appropriate 
test which will provide the most precise data needed to 
determine the solution. There are a variety of tests available 
for measuring many diverse traits and abilities. For the full 
spectrum of tests, and a critique of each test's uses and 
validity, consult Buro's Yearbook of Tests and. Measurement. 
A brief list of tests used by previous participants of a prob- 
lem-solving model workshop is included in Appendix 2 p, 
58. 

Some Illustrative Examples of Researchable Problems: 

Tfteoretical Hypothesis: Time on task by students has a di- 
rect influence on their learning performance. 

Operational Hypothesis: Students who spend more time 
working independently with instructional materials will 
make greater gains in measured reading performance than 
students who spend more time receiving direct instruction 
from the teacher. 



Personal questions about the formuliition and st.itt'ment 
of hypothesis: 

J, 
2. 
3. 
4. 
5. 

NOTES: 
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Activity 2:1 



Tut an O in frunt i>f hjpvthebeb IKat arc opcrdtiun^Dv iicfincJ> ii T in fr^i*i of hjpothcM-b thiit arc thcorvtua)!) defined, and 

a B if they are both. 

1. There will be MgnifkantI} m(jreimpri>\cmenl in readingcumprehenbiun, measured by the Stanford] 

E)iagnostic Te&t/ when an indKidi'alucd reading program is utilized than when a traditional group 
reading program is used, 

2. Children in a raciaJly integrated cla^r^ruom vtiH tn; mure aeademKalK Lumfortable. Academically com- 
fortable means more learning will take place, 

^ 3. Self concept wilt be impri>\ed by learning to read butter. Sell-Luntept mtanb feeling positively or 

negatively about oneseif. 

4. There will be a i^igmfieantl) positive relationship tM.twLt.n self-LonLL-pt and rjadin;^ achievement. Seif- 

toncept means a positive or negative fe-eling abtout oneself. Reading achievement means how well 
one readb. Self -concept will be measured bv the Coopersmith Self Esteem Inventory, arwl the Gates- 
MacGinite Reading Test Survey "B" will be used to test reading achievement. 

5. Children in a clabs where a rcgular teacher abtsent will not perform as well on the SRA Reading 

Comprehension Test ab peers of equal ability whoarc in a clabb with one teacher of regular attendance. 
Ability IS defined as scores received on SRA Reading Comprehension/ which is a machine-scored 
achievement battery administered throughout the district. 



Amu^ers to Activilt/ 2:J 1-0 2. T 3- B 4-0 5-0 
Write your personal operational hypotJiesis: 
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. Null Hypothesis 



The first step in iniliating a s)stenutiL prutc^^ in prob 
lem solving is to fonnulDtt.' and btak (he null h)p^thL*sib 
(Ho), The nuW h^fh>thc^ti> establishes a standard against 
which a problem soKer tests dala statistically. For example, 
if a problem soJver wants to lest a hunch (hat a ct*rtain 
method of teaching vocabular) development will re^uU m 
greater gams for students than a conventional method jf 
teaching vocabulary development, it suggests that (here is 
a need (o advance a statement that enables one to test that 
hunch. In order to test the hunch, the problem-soUcr ad 
vances the nuU hypothesis tha( there will be no (null) dif- 
ference in measuied reading comprehension t>etween the 
two groups regardless of the method of instruction em- 
ployed. The problem- solver teaches one group o/ children 
by the conventional method oudinedin (he (est and another 
group by the special method of vocabulary development. 
After completing a procedure of systematic problem-solv- 
ing like (he one outlined in the ICPS Model, vXKabulary 
da(a are collected and analyzed for each of the groups 
(aught. The measured results obtained by each group are 
compared statistically to de(ermine the extent the special 
mediod of vocabulary development resulted in a significant 
difference (p<. 05) test resultsobtained by the group taught 
by the conventional method. If the problem- solver deter- 
mines lha( a "statistically significant difference" exists be* 
twcen two groups, it can assumed that the observed 
difference resulted from the difference in the method of 
teaching used, it is at this point that the problem -solver 
will make extensive use of the nuJJ hypothesis procedure 
to make a reasonable decision to guide instructional objec- 
tives and approaches. While the assumption may be en- 
tirely justified and the method of instruction etmployed to 
, teach vocabulary development may have resulted in in- 
creased vocabulary^ it is also possible that some undetected 
or unrecognized external factor may have produced the 
observed difference in vocabulary perfortnance, Tliereforo/ 
any conclusion drawn on the basis of the null hypothi^sis 
must be weighed against the possibility of a valk) assump- 
tion proving to be ii "*rn*ct. 

The pioblen^sol" 'us( keep in mind the fact that the 
testing of the null h >thesii> only shows thai (he results 
indicate a dire^:tion for further study and future discovery,^ 
It is not enough to determine that one method made a 
difference over another method. The (eacher as problem- 
solver would not be f^tisfied with this finding as the$olC 
basis lor determining future actions toward teaching 
vocah'jJary development. As the person responsible for 
outlining instructional directions for many learners, the 
teacher as problem-s^)lver would want to know precisely 
what influenced the observed difference in vocabulary de- 
velopment in termsassociatedmore with quality of learning; 



rath*^rthan ^uantit> dlont\ in Ihib :>^.nbe the null hypothe^ib 
Mrvt3 to direct the dppltcaliun of problem ^olung methud^ 
to assist the teacher m determining which real differences 
t^i^cur when different leaching nfH?(hod±> art* emfjioycd. Even 
though the null hypothesis does aid the teacher in making 
^ decision about whether there is a difference- between two 
methods of teachings it does not reveal all of (he underlyir^ 
factors (hat influenced the resuhs. Testing the null hypoth- 
ecs IS just a single step in helping the teacher as a problem- 
solver to understand the nature and impact of in±>(ruc(ional 
decisions and approaches. 
Some Illustrative Examples o^ R^searchable Problems, 

Hypothecs: Studen(s who spend n>ore time working in- 
dependently with instructional matenals will make greater 
gains in measured reading performance than students who 
spend more time receiving direct instruction from (he 
teacher, 

NuH Hypothesis: There is no difft*rence in (he measured 
reading perfortnance gains for studen(s who spend more 
(ime working independently than for students who spend 
tnore time receiving direct instruc(ion from the teacher 
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Activity 2:2 



Write the null nypothesis for each hypothesis listed below. 



L There is a significant correlation between 
the number of books read outside of class 
and reading achievement in class. 



2. There is a significant difference in com- 
prehension between children reading ma- 
terial only orally and those who read it only 
silently. 



3. Children will significantly increase their 
retention of word meanings if they study the 
words' etyiT ologies. 



4, There is a significant positive conelation 
between children's enjoyment of reading 
and number of books in the home. 



Hypoihesis I^mW Hypothesis 
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Activity 2;^ 



Personal Questions about writing Null Hypothesis: 
NOTES: 



Write a hypothesis and null hypothesis tOi each of the following problem-solving questions. 



1* Do children understand oral or written instructions tetter? 



2. Do children understand ?nd retain a story better if they read it or listen to it? 



3. Do children who have laterality problems also have more difficulty in reading? 



4, Do children understand and learn the material better i( they can choose what they read' 



,4 
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Des«rl[bing 
the Fopillation 
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Establishing a Classroom Data Base 



One the key tools required for a classruam teacher 
interested in problem-solving is a classroom data base for 
alt learners. The classroom data base (CDB) provides foun- 
dational informatfon on each child that reveals demo- 
graphic and personal characteristics that might influence 
■The way each child reacts to insstrtiction in a group sctling. 
Many limes a weJJ-conceived and constructed classroom 
data base will reveal important patterns that define the 
nature of the group to be taught. Sometimes these class- 
room patterns suggest meaningful approaches to potential 
problem areas or provide a realistic base for interpretalion 
of observations and instructional planning. 

^e first ^tep in the establishment of a classroom data 
base (CDB) is the construction of ^ Classroom Data Profile 
Sheet (CDPS). The CDPS tsa form that lists key descnptive 
and numerical information on each child utilizing format 
that aids the teacher in spotting key relationships or sig- 
nificant demographic patterns. A sample CDPS pittured 
below shows the information that should be co1K?cted on 
all children routinely and some items that might be good 
to have on hand when there is a need to find answers to 
certain instructional qu' *ions. Sometimes solutions are in- 
dicated by the nature or the dispiay in the CDPS and no 
further study procedures would be called for to d****' with 
a specific problem. When additional datdai^^uired to 
answer certain questions, the teacher can associhtWnewly 
collected data with existing information and be in a better 
position to make appropriate instructional dccii^ionb. 



Instructions for Using CDPS 
Cfiart 



SeJ? — M I*, maie/r i*, fcmdlt' This ma) be (im.M tti Jt^iCoier tf ihm- 
Ls d rt'lationshtp between arid another vanabLe, such as number 
of books rt'ad. achievement or verbal ability 

Rlice— W - white B = black O = other 

Heie is another vanable which may have bearing on the students' 

performance 

Grade Point Average^.O =j A 3 0 ^ B 2.0 ^ C t 0 = D O = F 
sum of grades 

The tormula is r — i 

number of courses 

Title {--does this child participate in the title ( program^ 

Specbl Education IS the child enrolled in t\ specuif educMK^n 

program? v"*^ 

Special Reading Programs— Is the student enrolled in any Specnl 
reading programs iri the schroP LiSl programs 

Bilingual Program— Is the studi>nt enrolli^ in foreign tanguage 
proi > ims? 

Word knowledge — comprrhCftattm and totat w\rk sfjftfV ^ktUi. These 
are all tests the teacher can give to determine more prt*ctsely what 
the child's ability really is m readinf^. 

Numberof Books read by Student— give number of bt>oks>tudent!> 
have read during the oirrent y<^ar 

Responses on reading inteiest inventory— Us^t major int*;rfStS re- 
vealed in interest Inventory 

Latest available achievement scores^these wtll be available in thf 
Child's file. These scores will help you to gel a clearer, moreciim- 
plete ptCture of your !>tudent!>' !>trengths and vveiiknesses^ 

Scores collected for probtem Solving— ihe^t' f^yres ivill begathertxl 
trom the k-M;* you as the teacher Will givt the thiMrt^n Tht data 
received from iho^e tviU be nsvd ^.uppurt i*r rcfutt' vour tiv 
potheKis. 

RS - Raw Scort* 
SS = Standard Sc<ire 



Regardless of the study, the CDPS Chart shouJd include 
the whole class when filling out Sections 1-26. Only stu- 
dents involved in the study should he included when filling 
out Sections 27-31, 

Name--t he students' (subjects) names are entered first. This is for 
your benefit only In collecting data. If the study is published or in 
any way shared^ Federal law requirt's that the name be deleted 
from the study, 

ID#— tne identification number ^S also only for your benefit. This 
can be the number of each child's test file or one that you give the 
students lo ensure confidentiality. This may or miiy not be deleted 
from the final study. 

Age in Month^this iS calculated using the following formula 
y(l2)+f = a 

y = years ^ 
f = full months (over fifteen days) 
a s age in months 

This calculation is useful when the Atutly ret^uires more vxact meas- 
urement of flge than years. 
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Classiroom Data Profile Sheet 



1, Nairn* 








i 


. .__ --: , ■ i - - ^- -■ -: 


2 tD# 








1 

.... \ 






3 Age in Months 










..J^. . __ i i- i i .. . 


i 


4 Sc)t 




... .1 




1 • I 
i * - * <- i * . -i 








I ^ ■ 


T ■ i 

....... 1 1 ."*_.J 


6 Gndo- Point 








T T 

1 

.1 . ... . 






7 NumWrof Om'i> 




i 

■ i- — - 


, ^ — , ^ ,^ 

^ j ; 'r 


. — 


— — " — ' -f 

r 

/ 


8 MdjorMcaJth rtobJims 






: ; ! 

, L ,x i- .. . . 


General Background Fac- 
tors 






1 


1 1 

i 


I ; 1 

i i 1 

i . 1 . 




9 Title I f 






7 — ^ , 

'1 L_. . 
















. 


f 1 

' . . I .. .J 




' 


11 Spocia] Reading Vio- 






( 












: 


12 Bilingual Proji^rints 


* 








... J 


t 








Lotest Available Rtnidm^ 
Scores 












- — - -i^ — ^ 

-J 






13 iVorlJ Know|t^J(;i^ 
Vocdb RS 












i ■ ! 
i 

. . . _L . 










SS 




y 






^ 1 















14 Comprehension RS 






















SS 






















15 Tot.il RS 








J 


f— 












16 Work Study Skills RS 
























SS 








1 

1 














Background Factors 
Educational 

LAtp<;t AvAil^hlp 

Achievement 






















s 


17 No of Books re-ad by Stu- 
dent 

2 




T ^ 







9* 1 














IS Scorch on Rcadirig Inter- 
est Inverltories 
























19 Social Studies RS 
























SS 






' 


















20 Math RS 
























SS 

























21 Strionw? RS 






















1 


SS 
























22 LibLiry Skills RS 
























SS 
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Acdvity 3:1 



Criterion Checklist tot Classroom Data Base 



Yes 



No 



N.A. 



K Did provide fou.idational information that might influence the way 
each child reacts to information in a group setting? 

2. Did It reveal important patterns that define the nature of the group 
to be taught? 

3. Did it suggest potential problem are£ ' 

4 Did it provide meaningful approaches to polffnlial problem areas? 

5. Does It provide a realistic base fo interpretation of observations and 
instructional planning? 

6. Does it indicate that further problem-solving procedures will be nec- 
essary? 

7. Will more data have to be collected? 



Personal Questions about Classroom Data Profile Sheet 



List types of data you require for your study; 
NOTES: 



Additional Readings 



E^^y* Bornes, p. 33^ Dixon, p. 31 
h.jrd: Walles and Roberts, p. 100^ 
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/ 





22 



2S 



ERIC 



^Selecting and Describing the Samples 



When teacherb alk^mpt to gather data on Muctcnt^, lh<.> 
are ubualty interested m making obborvalionb and th^n 
dnwing conclusion^ from lh*,*be ob^crvalions. L t^aeherb 
c n observe all instances of a population ihey can, with <i 
degree of confidence/ ba^e corKlusion^ about the popula 
lion on these observations. This IS/ usually the uis^.*/ vvhtn 
an individual teacher with a single class of students is m 
volved. In other situations where teadiers want toob&er\c 
only some instances of a population^ they can do no more 
than infer that the^e observalions are representative of tf*t 
population as a whole. Basically, this is the concept of ^am 
pting^ which involves taking a portion of the population/ 
making observations on this smaller group and generalising 
the findings to the lar^^ population. Sampling assists the 
problem solver in studying a portion (sample) of the pop^ 
uldtion rather than the entire population. The i>tmll ^rotip 
that ts observed is irallai a sample and the hr^er ^roup al?oitt 
^vhtdt the gemaiizatton fe made is i.<\lled a popttlatton. A ^fop^ 
ulatiort comprises all the mauhers of any ivell^dcfined 
peophf events, or ot/ecls. A ^mple ts ^tmplxf i\ portion of //k 
population. 

In order for your study to be of use to olher teachers, 
yoii must also define the important chaVac tens tics of >our 
subjects that may affecl the expenmentS outcome (n^e 
Classroom Data Profile Sheet in previous section). (Other 
teachers may be able to determine ho\^ successful >our 
treatment will be for their sludentN by comparing the iwo 
groups of students on salient characteristics Itke reading 
habitS/ attendance patterns, whether the child hits access 
to a library/ and reading interests.) For instance, if >our 
students are mostly white/ middle ctass/ children attending 
a rural public school/ the treatment that may work sui. 
cessfully for them may not work for children in a affluent 
suburban private school/ or an urban racially mixed pubik. 
schook Other characteristics to be considert d are suggested 
in the Classroom Data Profile Sheet shown in previous 
chapter. 

How your subjects were selected is anolner important 
factor to note^ as this will help determine the statistical 
analysis used to proc^ess the data. There are types of sam- 
ples you can select: matched related samples/ random in- 
deper^dent samples. 

An independent sample fe present when the experimen- 
tal arKi the control groups have been drawn randomly from 
(he population. Every su}:iject has an equal chance of being 
selected for the sample. When the two groups are drawn 
in this way it is assumed that they are essentially equal. 
Then/ the experimental group is given the special treatment 
and the control group continues to receive regular treat' 
ment and any difference in the performance is assumed to 
be due to ihe difference in treatment. However/ if by the 
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nature of )our stud) you cannot assume the two groups 
are equal as is often the case edu(;ational problem solv 
jng. then all subjects must receive the same treatment, and 
a related or matched sampling must be used 

H matched sampling the two groups are divided indi 
\iduall} into pairs that ha\e equicalent characteristics that 
might affect performance, rach member of the pair is then 
ai^signed randomly lo one group or the other or the sub- 
jects are tested Iwice and each subject serves as his own 
i.ontroL When matching, il is necessar> lo make sure the 
pairs are malchc\l o\er e\.er> possiNe relevant character^ 
istic. Otherwise/ >ou will get irrelevant or possibly insig 
nificant results. 

In many instances^ a teacher may choose lo try a new 
treatment with [he whole class to see if this method pro^ 
duces greater gains than the class as a group made previ 
ously or greater than normally expected at their age and 
grade level This type of study does not require she sam 
pling procedure as outlined. On the other hand if a teacher 
wants lo divide the class into two or more groups lo test 
different methods/ these sampling procedures will work 
quite well. ^ 

At times it is not feasible to acquire a group that matches 
the characteristics of the group receiejng the treatment 
being used by the prot !. ..vsolver. Iti those instances, it is 
possible to detrrmine whether or nr' there are significant 
differences between groups receiving treatment and those 
receiving no treatment. If there are significant differences 
betwet*n the performance of groups receiv ing the treatment 
and the performance of groups not receicir^ treatments, 
It can be assumed tliat the treatment made the difference 
in the observed performance changes Most problems in 
reading require teachers to \^ork with groups thai are not 
matched. The procedure for determining ihe extent to 
iAh..h groups differ on a specific performance should be 
folbwed. 

NOTES: 

Personal Questions about selecting and describing s^imptes 
1 

2. 
3. 
4. 
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Some JJJustratir^e Examples of Selecting and uostnbjng 
Samples: 

Example Ore; A leather is interested indir^idm^^ the class 
into three groups that are equir^alenl in performance on a 
common measure of reading. In order lo select students for 
each of the three groups^ a random method will be em- 
ployed. Arrange all stud^nls in the ciass in soi;.c orderly 
sequence: alphabelicalJy by surname^ by birth dan (young- 
est lo oldest or the reverse), any other systematic arrat\go-^ 
ment. Then assign each student a number. Write the 
number corresponding to each student on a smail piece of 
paper and place ^It the numbers in a box. Shako up the 
numbeis thoroughly. Select a number vithout looking i 
the box. Record the first number selocti d under Grou^ 
Piace the number m Ihe box and shake before >Hecting 
another number. Record the second number selected to 
Group 2. Replace the t\umbt?r shake and select a third num- 
bi*r for recording'under Group 5. This procedure should be 
repeated until aJI students are assigned to one of iho three 
groups. Once students have been assigned to oi:e of the 
three groups^ the teacher is read> io begin the treatment 
phase of the problem^lvit\g process. 

Example Two: Students can be divided into sample 
groups ot\ the basis of sex, MaJos students are assigned tu 
one group at\d femaJe students are assigtied to ^^nother 
*group. 

Example Three; Approximately hah of the students in a 
cJassroom were givet\ a specialized ptogram in reading the 
previous year and the teacher is it\terested in determining 
if there has been a cumulative effect on these children's 
reading performance ut\der certain conditions. All students 
who had the specialized program are placed in otiesample 
group. The remaining members it\ the class are put in the 
o;her sample group. 

Example Foun \n a school that has assigned students to 
different cJassrooms at the. same grade leveJ on a hetero- 
geneous basis. For example, a fifth grade teacher might be 
interested jt\ employitig a different approach to vocabulary 
development that is different from the approach suggested 
in the regular instructional materials. Iti order to determine 
whether or not this different approach to vocabulary de- 
velopment will have lead to significant improvements in 
performance, two different fifth grade classes can be 
thought of as sample groups. Salient characteristics of each 
classroom should be described and a determination of how 
each group compare prior to the administration of a treat- 
ment to the experimetital group. 



Example of Sample Description— Data on Fifth Grade, 
■ Month of October 



Students 


Age in Mos 


Sex 


Race 


Raw Score in 
Reading; 


1 


IZ5 


F 


W 


87 




132 


F 


B 


73 


3 


127\ 


H 


W 


4~H 


4 


134) 


M 


B 


68 


5 


126' 


M 


B 


39 


6 


129 


F 


B 


89 


7 


130 


M 


W 


63 


8 


135 


F 


W 


78 


9 


129 


M 


B 


59 


10 


136 


M 


W 


85 




1303 


5F, 5M 


5B, 5W 


689 


Mean 


J30.3 






68.9 


Range 


125-136 






39^7 



The average age of the group is 130 3 months with the youngest 
125 months and the oldest being 136 months Fir^e members o^ ihe 
sample are female and five members are male. IHalf of the sample 
IS compnsed of black students (2 females and 3 males) and half are 
white students (3 females and 2 males>). The average ra^ store on 
a com on reading test for members of the sample is 68 9 with a 
rang6 of 39-87, The average raw s<:ore of 68 9 translates into a 5.4 
reading grade level score. In g^eraL this js a cooperative group 
of studenti> who work up to their ability on most occasions There 
dre few if any discipline problems and students are hi^ly moti- 
vated to complete assigned class work. Reading interests of group 
members are vaned and refleo expert patterns of students from 
ifimiliar l>ackgrounds. These students coit^.' from average working 
class backgrounds with parents who are generally supportive of 
their children's school activities. 
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Matched vs. Independent (Random) Sampling 



Popul 

• •• 

** 


ations 

ooo 

□ □□ 

** 


Sam 

Matched 
Group I Group 11) 

• • 

□ □ 

Each member of the population is matched with another member 
with approximately the simt relevant characteristics. 


pies 

(Random) Independent 
Group I Group II 

■ □ 

. o * 

Each member of the population has an c<iual chance to he chosen 
in either sample. It is highly probable that the two populations 
will be approximately e^luivalent. 
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Activity 4:1 



Checklist for Determining Types of Samples 



Mrs, X is a fourth grade teacher who knows she will be ill for a month and a (wJf, She drades she would like to know 
if her reading class will be affected negatively by her absence and with the presence of a substitute teacher for that time. 
She deades to measure her group against a group tompnsed of other fourth grade reading students, frum a variety of 
different schools, but each ^( whom vtill have his-tier regular teacher. The students were all nine years old and of the 
same race* 

Yes No N,A, 

1- Are the two groups equal? 

2, Is it an independent sample? 

3,*Are there other effects b^des ihe absence which might affect per- 
formance? 

4- Js there a control group? 

5, Js it a matched sample?* 

6- Is there a special treatment? 

7, Jsa pretest necessary? 

8, Js a post-test necessary? 

Discuss this example in a small group, and then consider your own sliidy for consideration. 



Additional Reading$ 



Easy; Dixon, p. 32; Barnes^ p. 33; Ferguson, p, 3J2 
Hard: Wallis. p, 100; Calfo and Miller, p. 25 



26 



step 5: 
Selecting 
^the Study Design 




27 



ERIC 



33 



Selecting the Study Design 



When selecting the design^ the main consideratjon is tht^ 
type of question asked. The question may involve ^ simple 
companson between two measurements^ i.e., test scores. 
It may, also deal, with the effects a treatment may have 
whenapplied to one/two/three groups. In thtscase^ a pretest 
and post-test will be necessary to examine^ precisely, the 
effects of the special treatment. The following summary 
tabulates eleven representative study designs. A more com- 
plete list of basic statistical models occurs in Chapter 7 after 
a discussion of nominal, ordinal, and interval level meas- 
urement, which is a necessary determinant for using the 
correct model. 

Study Designs: 
Statistical Models 

1. Que Group — Trcatswnt — Post*tcst 

E — * Treatment ~^ Post-test 

Assumptfon: neither pretests nor uses a control goup Introduces 
a treatment and evaluates the post-test^ attnbutir^ any assumed 
change to the treatment. Generally a pooi model 

Eifample: a teacher instructs a class on fractions^ tests for under- 
sUrKJing^ artd evaluates to some assumed startdard 

Appropriate statistic: normally, none. 



2. Jmo GroMp»«'Trcatn«iit*-Po«t*t<st 



El 

E2 



Treatment 



Tost-test 
Post-test 



Asftumption: two groups assumed to be equal beiore exposure to 
the same treatment. Tests for difference between the two groups 
on the posMest. Attributes differences to the ability of the groups 
to relate to the task. 

Example: a teacher assumes boys and girls do equally welt on math 
tests, leaches ^ math lesson using only sports examples and then 
tests to see if boys did significantly better than girls. 

Appropriate statistic: Bmomial Test or Chi Square for one san^pte 
{Equaiuttts. p. 53. Sample Studies, p, 58) 



3. Imo Grovps— Two Tr»«ttt«Dit#— Poot*t«st« 

\ Post-test 



El 
E2 



Treatment 1 
Treatment 2 



Assumption: the two groups arc assumed to t>e equal t>eforo the 
treatments. Treatment 2 may either be a different treatment from 
\ot no iteaimtnt at afi U no treatment is given to one groups tt is 
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called the Cuntrd Cruup iQ, ai> oppoiid Iv the Expenmental 
Group (E). 

Example: a teacher may want to take two groups of children of 
equal ability to test the effectiveness of two separate methods oi 
teaching a particular reading skill One group is taught by n^ethod 
A, the other by method B. Both groups receive the same post-test 
after the treatment. Any difference is assumed attnbutable to the 
difference in the effectiveness of <^e method over the other Or 
the teacher may select groups of assurr^cd equal ability and teach 
onlyoneanew learning task and pos -test to see if the nev/ method 
produced a significant difference in f>erformance t>etween the two 
groups. 

Appropriate statistic: Binomial Test lEquatuta. p. 53. Sample Studv. 
p 5$). 



4. Ooc Group— Prcte«t/F ost*tc»t 

E -^Pretest— ^Treatment *^ Post-test 

Assumption: the only change between the pre* and post-test is the 
treatment. Thus any difference t>ettveen the pre- and post-test 
scores is attributed to the treatment. Note that this model only 
differs from Model 1 m gathenng prt-lest information for connpar- 
ison with the post-test, ft is the availability of two sets of scores 
for companson which makes this m^>del stronger. Its results can 
t>e tested. 

Example; a teacher may want to know if removal of fear of failure 
woutd increase spellir^ grades. The pretest would^ a spelling 
test under normal conditions, the treatment would t>e an an- 
nouncement that anyone who tries ^vill receive a passing grade 
and the post-test would be another 5pefl)ng test after removal of 
treatment. Any difference in performance would be attributed to 
the charge in test conditions i^ssumw^i the test to be exactly the 
same or equally difficult. 

Appropriate statistic: ^{cNemar Test for Significance of Charge 
{Equation^ p. 53). 



5. Two Gffottp*— Py«te«t/l*ost*te«t 



El 

E2 



Pretest ~^ Trealme n t ~^ Post-test 



Assumption: two groups are assumed equal in the pretests but 
different on the post-test following ttie same treatment. Any dif- 
ference in performance would be attributed to the difference in the 
ability of the groups to relate to the tatk. Note that this model only 
differs from Model 2 because it includes a pretest. The presence 
of a common pretest score for the two groups albws the problem 
solver to test whether the assumption of the two groups being 
equal is validMt is a stronger model for this reason because it 
operates on one Jess assumption. 

Example: same as Model 2 except that a teacher pretests the boys 
and girls to establish their equal abilitv before the treatment rather 
than assume it. 
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App topnate statistic: Binomial or Cht Scfuaro for one sample {L^ua- 
Hons, p. 53. Sample Studtn, p. 58). 

€. Two Gro«p«— Two Treatments— Pretest/ 
Post-Te«t 

^ Pretest Ct f^^tn^^"* ^ ^ Post-test 
E2 ' ^ Treatment 2 ' 

^ 13 Pretest s:!''''"^^*'"^"* "^Post-test 
'C ' ^ No Treatment ' ^^'^ 

Assumption: the twogroups are assumed tobe equal in the pretest, 
but different in the post test after different tnratnicnts. The differ* 
ence would be attributable to the duferin^ treatments. Note that 
Treatntent 2 may be no ireijtintnt at No treatment groups are 
called Cotttrot Croups. 

Example: same as Model 3 except that a teacher would pretest the 
two groups of children to establish cquaJ ability instead ofassuTnin^ 
equal ability before the treatment Thus, it is a stroi^er moclelthan 
Model 3 because it operates on one less assumption 

Apptopriate statistic: Mann Whitney U Test or T Test {Lquaii^n. 
55, 5ample Study, 



8. Relationship Between Two VaHables For 
One Group 

(X; 





Read- 








Subject 


ing 


Rank 


Math 


Rank 


1 


70 


5 


84 


1 


2 


75 


4 


83 


2 


3 


84 


1 


73 


5 


4 


80 


2.5 


79 


3.5 


4 

tr 


80 

ft 


2.5 


79 


3.5 


N = 


XN • 




YN 





Assumption: reading and math tests are independent. 

Example: the teacher wants to know whether reading and math 
performance are predictive of ^ach other that jsr whether there js 
a significant relationship bet^e^n readti^ and math scotes for her 
his students. (S)he then lists a reading and math score for each 
subjects ranks the scores and the total number of studentsi and 
uses a formula to test the relationship. 

Appropriate statistic: Spearman Rank Correlation {Equatm, p 56. 
Sample Study, 64). 



7. CIa««{|icetlon of Reletionshlps 

Reading Ability 





Low 


Middle 


High 


Male 








Female 









Assumption: the distribution of boysand ^irls among low/ middle, 
and high readers/ if reading ability were divided into three sets, 
would be either relatively equal or significantly different. 

Example: the teacher believes that girls generally read better than 
boys. She divides reading scores into, low, middle, and high and 
notes the number of boys and girls in the higher classifications 
wouki be gteater. In other words, there should be a significant 
difference in the distribution ofg;irlsand boys among high, middle, 
and low ability readers. The significance of the difference in dis-* 
tributions can then be tested. An alternative would be to assLime 
no difference in the relative distribution of boys and gtrls among 
reading ability groups and then test. 

Appropriate statistic: Chi Square (Equattm. p^ 55. Stimpic Studif. p 
5S). J 



9. Difference Between Reletion«tiip« 



Boys 


Girls 


Read- 




Spell- 




Read- 




Spell- . 




ing 


(R) 


ing 


(R) 


ing 


{R) 


ing 


(R) 


85 


1.5 


82 


3 


80 


3 


85 


1 


70 


5 


59 


6 


86 


1 


79 


3 


63 


6 


61 


5 


73 


5 


68 


6 


85 


1.5 


75 


4 


62 


6 


73 


5 


75 


3.5 


85 


1.5 


80' 


3 


79 


3 


75 


3.5 


85 


1.5 


80 


3 


79 


3 


ti 












H 





\ / 

Correlation 

\ 



*Sprar 
man 
Kattk 

tt<ftT 



\ / 

Correlation 

/ 



Difference of Correlations 

Assumption: there either is or is not a relationship between the 
relationships of reading and spelhng for boys and giHs. Tests fo: 
a significant relationship across groups. 

Example: the teacher wants to know if the relationship between 
reading and spelhng performance is the sam£> for boys and girls 
In other words, do girls arvd boy^ differ in the degree to which 
scores on one test predict the other The relationship between 
reading and spelling i;; calculated for each group and the relation 
ship bet^veen the correlations is tested. 

Appropriate statistic: z = MNr 3) 

Significance of the difference between two correlation coefficients. 
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10. Mwm Thtm Two Groups 
Ob Omm Variable. 



Reading Scores 
Group 



A 


B 


C 


D 


40 


56 


51 


60 


65 


49 


61 


63 


55 


49 


61 


63 


57 


46 


58 


51 



Etc, 



Personal Questions about Selecting the Study Design: 
L 

3. 

NOTES: 



Assumption: ihe groups are not different, thus the test is for dif- 
ferences between group means. 

Example: the teacher designates three reading groups based on 
assumed differences in reading ability. This model allows the teacher 
to achtally te^t whether assumed differences are leal. based on 
scores from a reading test. 

Appropriate statistic: Kniskal-Wallis One Way Analysis of Vari- 
ance iEijuatiort, p. 56, Sample Sludy, p, 62), 



11. RttlatloMhip Afliong Three or More Vari* 
aUes for One Group 







Fear of 




Subject # 


Self-esteein 


Failure 


Achievement 


1 


60 


70 


60 


2 


82 


80 


75 




70 


75 


65 


4 


75 


70 


75 


5 


65 


65 


65 


N = 


XN 


YN 


2N 



Assumption: self-esteem, fear of failure, and achievement are all 
independent (have no relationship with one another), 

Examfde: a teadier wants to find out if self-esteem, fear of failure, 
and achievement are predictive of one another or if there is a 
signifieantiy strong relationship among these three variables. 

Appropriate statistic: Kendall Coefficient of Concordance: W {Equa- 
tion, p. 57 Samptf Study, p. 61). 



To assist^in selecting the sample/design, the following 
table compares a significant difference study and a corre- 
ladonat study. A correlational study tiasically seeks to find 
a relationship between two ideas, concepts, or topics. A 
significant difference study seeks to find differerices be- 
tween two measurements; i.e., performances and scores, 
By using the comparison, one can answer questions about 
sample, design, and treatment using the checklist in Activ- 
ity 5:1, 
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Activity 5:1 

Foirattat of Problem *Solving Procedure and Design Selection 



Example A: Correlational Study 

Problem i 

The n^lattunship of motivatio;i and dLhtcv^mcnt 

Hypothesis 

There is a relationship t>ctween motivation as measured by the 
Brow n-HoItz man Surve> ot Sti^dy Hahts ctnd AttituUe^ and 
Achievement Tests. 

Null Hypothesis 

Tliere is ito rd^ttunshtp betwei^rn motivdUon and dchjt:>t^mtnt. 
Procedure 

Give all the students both tests at approximately the same time 
under the same set of arcum&tances 

Results 

The scores obtained on the achievement test and tht motivati^jn 
test are ranked for eath sub^et^t and the two i,tores are compared 
to see if the subject scores high on one test whether he will score 
high on the other test also. Com]>arc the two scores using a cor^ 
relational technique. 

Conclusions 

}f a strong relationship is established, then wo have obtained sup- 
port for our hypothesis. We may reject the Null Hypothesis. We 
then find there is a strong relationship between motivation and 
reading a^hievenient. Thjs could lead >ou *\} look ior bettei ways 
to motivate your students. If you found thai there wasn t a strung 
relationship betwet/n tht teathing te^hni^ue^ and ptrformjn*.e or 
days tardy and performance then prublt^m-solvjng process will 
t>egjn again. 



Example B: Significant Differences Study 
problem 

Is oral or written presentation of an instruction more effechve for 
my class? 

Hypothesis 

The subjects will perform t>etter on a test J oral rather than wntten 
instructions are given 

Null Hypothesis 

There will be nu diftereri^e (signihcant> in tht pt^rf^rmance of dif- 
ferent groups on the two tests 

Procedure 

Two tes^s on the same topic of comparable difficulty will t>c given 
to students within a week to a month apart One will be given to 
half the class orally; one will be given with written instructions to 
the other half of the class The other test will be given in reverse 
urder, the half receiving oral instructions tne first time will receive 
written instruction this time and vice-versa 

Results 

The difference between scores and which set of scores was higher 
will be found and the average difference calculated using the VVil^ 
ax<on-Sign rank lest 

■ Conclusion 

If the performance un the orally presented test is signihtLantly better 
than the performance on the wntten inst^puchons test, then we 
reject the Null Hypothesis and hnd support for the hypothesis that 
orally presented instructions are more effective than wntten in- 
structions. Based on that data/ you would present your instructions 
orally^ and/or train your students lo handle wntten instructions 
better. If there were no difference^ this would indicate both modes 
should be used or that the instruction mode has no important effect 
on the results. 
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Criterion Checklist for Format of Probtem-Solvins Design/Procedure 



E)fample A 


Example B 


Your Own Sludy 


Yes No N.A. 


Yes No N.A. 


Yes No N.A. 

1 Am J Irving to find if iherc is <i rehtionship K*lw^-*^?n *iny 
two or more trails, scores, or beh<iviors? 






2. Am 1 trying to find if tht^re is a signifiomt differena* 

between two sets of scores for ono group of subjects? 

3. Am i coinptiring the perform<iiKes of two groups of 
sub)ects? 

4. Did I test the two g>**>ups of subjects before the tre<itment 
began (i.e. pretest)? 

5. Am J trying to determine whether one group of subjects Vall 
into (1 category more often than another group? ^ 

6. Am J comparing morrj than two groups of subjects? 



Additional Readings 



Easy; Dixon, p, 35; Barnes, p, 52 

Hard; Wallis and Roberts, p, 211; Calfo and MiJIer, p, 153 
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Procedures 



The procedures of o btudy includes time and arcumstan 
ces of all activities involved in the problem*solving process. 
This section outlines what data are to be collected and re* 
^ corded, Kow data are to be collected^ the natui^ and extent 
of the treatments to be employed/ the instructional tech- 
niques and\materials required^ and the time required to 
complete all^divities. A description of any treatment/ in- 
terventio^n aporoach or maferial used in the study is given 
^ in the procedures section. 

In the procedure section the problem-solver should list 
. all activities in sequencial order with as much detail as nec* 
essary to guide the study process in the direction intended. 
This is the point where the^ problem-solver should specify 
the specific details of what should be done^ the nature of 
''fj the Organization/ ope rationalize the schedule of eventS/ 

determine data requirements for collection^ recordings anal* 
ysiS/ and reporting. Listing all procedures will lendcredi* 
btlity to your results. It will also assist teachers who are 
interested in replicating your study or at the very least 
make use of your treatment in their classroom instruction. 

The real value of the procedures stage is in the organi- 
zation and evaluation of plans for conducting a given study. 
It helps the problem -solver to perfect the formation of ideas 
and to help localize and pinpoint the problem tha* is to be 
studied. Because a careful articulation of procedures pro* 
vides assistance in improving the formation of ideas that 
refine and further define the problem to be solved. It isour 
assumption that each improvement in idea formation and 
problem definition reveals new insights and observations 
that often yields new data to improve .judgment and in- 
structional practice. Given this important contribution/ the 
problem*solvir^ process that a wel)*reasoned statement of 
procedures can make/ this section should be developed 
with care. 



Some Illustrative Examples of. Procedures 

Example One: In order to determine how the nature of 
the time spent by students affects their measured readir^ 
performance, the class will be divided into three groups 
that are equated with regard to present measured reading 
performance. Each group will be taught for 50 minutes per 
day for ten consecutive school days The 30 minutes periods 
will be divided thusly: 



Total No. 
Minutes Spent 



Within Between 
No. of . ^ Treat- Treat- 

Groups Minutes Treatment ment ment 



#1 


5 


. Teachers demonst/ate 
and explain lessor 


50 






20 


Student workir^g 
independently with 
instructional materials 




300 




5 


Si I ] d tytp^f^ h^ r 
interaction 






#2 


20 


1 

Teacher idemonstrate 
and explain lessor) 


200 






5 


Student working 
independently with 


50 


300 






instructional 
materials 








5 


Student/teacher, 
interaction 


. 50 




#3 ■ 


5 


Teac her <le mo ns t rate 
and explain lesson 








5 


Student working. 

independently with 
^ instructional 

m^tenals 


50 


300 




20 


Student/teacher 
interaction 


200 







Students working independently with instructional ma* 
terials in Group #1 will receive the greatest amount of 
instructional time^ students taught by*teacher demonstra* 
tion and explanation in Group #2 will receive the greatest 
amount of instructional tim^and students taught pnmanly 
through the use of Student/Teacher Interaction, Group #3 
will receive the greatest^^mount of instructional time. At 
the end of the treatment fcur each group a post-test is au- 
ministered to measure chaifee* in measured, reading per- 
formance. A statistical test will be applied to determine if 
observed differences are significant. 
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Activity 6Tr 



Cttterioii Checklist for Problem-Solvins( Procedure 

V 

Below IS an example pf a lisi of procedures. Wnte all information and determine if ^It needed information is listed in 
the following activity. Examples of steps taken in implementing an experimental pi^^edure 

' 1, I compiled the data for the COPS charl 

2. I administered the Ginn Test on October i, 1977 in the afternoon dunng reading class to ^11 students 

3. I th^'n implemented my individualized reading programs b> cvaluatinj^ Ginn re^uJt^ and dctcrmmjn^ tht iipprupnatf^ )e^e[ for ca^h 
child, then 1 compiled a ^ ork packet for each child and distnbuted them Ever) Fnda> I had a cunfcrentc with trath indjvidudl student 
to assess his progress and answer ^ny questions. ^ 

4. May 1, 1 administered the Ginn4n the same w^y as I did on October r 

5. I compared scores received in October ^rx) May to find if there w^^ significant improvement ^ 



Pretest 

What was the date of the pretest?:^ 



What time of day was the pretest administered? 

Was it admini' red to the whole dass'* 

Was it administered to a small group? 

Who administered the pretest? 



How muci} time was used to administer the pretest? 



Treatment 

What were the specific activities of the treatment?- 



What preparation was made by the leacher for the treatment?. 

How long was the treatment period? 

What materials are required for each treatment? 



Fost'test 

What was the date of the post-test? _I 

What time qf^day was the.post^test administered?. 

Was if administered to tKc whole class? . 

Was it administered to a sm^Jl grouf^. 



How much time was used to ^iminister the pnst test?. 



This IS a more speafic look at ihe problem's olving proceduren After cumpleting thu t.ritt'rion checklist for the <ibove 
exairple^ apply the checklist to your own study and discuss in groups any problems. 
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Your Personal Questions about Procedures; 
2. 

5. 

NOTES. 

Additional Readings 



Hard; WaJIisand Roberts, p. 142 

\ 



\ 
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$tei»7: 
Processing the Data 



Processing the Data 



When yt)u process daU for soking (in mstrucnoriiil prob- 
lem in readings ycti basically will eilhirr wanl tu know, 
''what IS the relationship between Ihese two traits?" or "is 
there a significant difference between two defined f^roups'" 
If yOu wish to find a relationship you will use a a^rrolalum 
technique like the Spearman Rho and others .htch are 
listed in the appendix Tht? type of correlatmn method you 
use will depend on the leveE of measurement of your data 
and whether you wish to find tht* relat4onship4?etweon two 
groups or among more than twogryups. If you .^rc l<H:king 
for a significant difference, that \f, a difference tutweeii 
two groups that is large enough ^nal it prot\ibly cannot he 
reasonably attributed to change, you will use the Mann- 
Whitney U or another test of this type listed i n the appen- 
dix. Which test of significant difference that you wilt tisv 
depends on several factory: the tvpe of sample jsed, the 
design of the study, the ll?vel of meaMirt*jnent of yi)ur data, 
whether your groups ^tre randomly sampled or matched 
sampledy the number of subjects in each t;roup and the 
number of groups tested. See the chart in Appendix p 
52 summary of the types of statistical methods. Jypes uf 
questions answered by each method, tlie levol ot measure- 
ment, and the equation 



Levels of Measiurement 

The level of measurement refers lo how precistiy the data 
are nicasured, and there are four levels The lei*st prease 
level of measurement is the nominal scale whttii is obser- 
vations of unotdered eategones, In the ordinal scale the 
datfi can be ranked. The interval levet of measurt*r:itnt re- 
quires that the difference in twottmsectitne values \a the 
same as between any two other consecutive values And 
the most precise measurement ratio requires at» atviohite 
zero so one scale value could be said to be twite as large 
as another value. Below art* examples of each level of meas- 
urement. 

Nominal level— boys, girls, Indian, Black. White and Ori- 
ental. These groups cannot be compared and ordered. All 
itemsor subjects are either in one group or the other They 
cannot be in more than One grioup. 

Ordinal I eve I --Attitude Toward Reading Scale. Disruptive 
Behavior Rating. The values of the diffea'nt data can be 
ranked /rOm the highest to the lowest, but the di/fcrerKes 
between consecutive scores are not equivalent. In other 
words, if A =31 and iJ = 33 and C = 35, you can sav 
A < B < C, but cannot say P - ^ C - P 
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Jntervaf level— Some \ Q tests, a spelling lest, a viKabulary 
test The difference between scores are equivalent so you 
can say B - A = C - B 

Ratio Level— \ard stjtk Ver% few things in the behavioral 
saenct'S can bv measured so prtrtrseh Ustng this levt*l of 
measurement one tan say X - 2v or Abbv is two times as 
tall as B^n. 

In choosing the best technique for processing your data, 
you wtll want to choose the most powerful test. The most 
powerful test is the one that mt>st often rejects the null 
hypothesis, there is no difference between groups due to 
the treatment when it is false. 

Preparing the Data for 
Processing 

Before intea^ntial statistical analysis can be performed on 
the data, however, it must be organised and summariited 
Descnptive statistics are used for this purpose. Descriptive 
statistKS may indicator the data's central tendency or aver- 
age, its variability or diversity^ the location or place of its 
scores in relationship to one another and the corrclat* ^n. 
The typt* of descriptive statistic used will vary depending 
on what information is needed and what level of mt'aSure- 
ment the data is. The folk> wing chart summanzes the types 
and spt^cifies under what circumstances they are used. 

fn addition, most inferential statistics require that the raw 
scores be ranked. The ranking procedure is as follows: 

1 PlaLe all the first set of sa)res on a chart, arraf^g^'d from 
highest seore to lowest M.ore, keeping all scures for one 
individual on the same hne. 

2 Number the scoreSy the highest store being numbered 
1, the lowest the number equal to the numtwr of scores. 

3 If there are any ties, they are all ^ssigned the rank which 
represents the average of the number of ranks the store 
would occupy. 



Example 

Scerf5 




33 


I 5 


= n + 2> ttcs are asstxytett rattk^ frv aver- 


35 


7 5 


2 t^i^ifi^ the mttnWr of r&t^k$ the 


35 


3 


scores u\ud<i ocatp}/. 


30 


5(4 


+ 5+ 6) 


m 


5 


3 


30 


5 


The fast rank v:iU du?a\f$ equ&t 


2$ 




the mtm\>er of scores 



Types of Measures 


Levels of Measurements 








Nominal 


Ordinal 


Interval 


Indices of central tendcnc) 


Mode (most fr^^ioont scoro) 


Median (middle Ea>rc) 


Mean (average mid valoe) 


Indices of variability 


Range {nv. iff scores bc*(ivot?n 
highest and lowest) 


Qoardte devi^ilign (no of scor<>s 
bcnween tht" bottom '/i and top 


Vanana' and Standard deviation 
(the average difference of a score 
from the mean?) 


Indjtes ol location 


Label or Llassif^atiifn (categ^>nt?s) 


Percentile rank (percentage of Z-score, Z-score and olher stand- 
scores = to or less than thaK^ iird scores (distance a score from 
score) the mean) 


Correlation 


t 

L 


Spearman Rank (degree of rela- 
tion shtp between scores) 


Pearson r(closeness of agreement 
of two samples) 



Your Personal Questions about processing the data: 

1, 

2. 

3. 

4. 

5, 

NOTES: y 

(See Sample Studies for lUustrativ^e Examples on pages 58-651 
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Should I UK the 
probteui-tolving method 
to answer my quettion? 



X 



Am I looking for ilgnifleant 
ifif fcrence a^tong variable*? 

1 



I 



Am 1 looking 
correlation among 



for a 

variable*? 



iVesi 



Are my duu from 



U$e Bmomtai Tfst 
or Ch S^Jmrf 



No 



Ar^ my dala ordinal 
I eve] (tf mca^untmenJ? 



ow-sarttt>le 



Are my d«t« from fi two^mpte cA«eT 



Ar^ mydau froni 



Are my data nomioal 
level of m^dfuremrni? 



Use MtNetrtar Test foi 
StAmftrattt OtanRe$ 



No 



Are my data ordinal 
Ifvd o| measunementT 



U^eSifiH Test 



Axe my dau jnttryal 
levfl of mtasuremfnn 



— 



hr Matettett Prtrr< 



r 1 





Arc mv dMA from 




rAo(f^>rn Mmplc^T 




Ate mv di^ra mammal 


level of mCiifUfi'mfniT 


1 




No 


r 1 

U^ Ftsher Te^t nr 
' Cfit S<tUttre kit XW^y 
u\i\et^'ttdettt tn"J/ilr< 


1 




A 


re fVty data ordinal 


fevel of ntfatur^ment? 



Uh Jyin^cr 
WhHney U 



Afe my data kntCf val 
l^fl of mta^Uf cmf ni T 



— f~ 

J3L. 



Uit Handoititted Test 
for 7uH> tntiej)en<ient Samht^^ 



Art mj data from « three 
«>r mprm sample cmmT 

i 



Ant my ilaia Jfom matchftl ^^impf*'**? 



R 



Are my data nonibnal 
Ifvfl ol measur omenta 



U^ Cochrati Q 



No 



Are mv tlata ordinal 
level of mcasufCmcj^tT 



U^e F**^ift»itn Tu'tJ tVflv 
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Correlation Tests 



Uie Correlation tttts 



'Yes- 



Ar« my dmtM coniwrlfig 
two varUblM T 



Arm my datm con«pi^lfc»t 



Arv rxiv ddtd from random sdmpln? 



Ar<* mV d*JJ onmiMJ 



1 



On S^niif^f for 



Ar?mv diu ordinal 



— 



Art my ttJU nominal 



Cofftfient C 



Of KftiM Rank Corn^tittfOti 



An my diU nominal 



No 



Art my d*ta orJmal 
tt ve\ of meaiunmf nt ? 



K^ndatt Pama} Rattk 
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Parametric versus Nonparametric Jest 



A parameter is a char^Ltcns^tK clemt'nt oi a pL>pul4)tiL>n. 
Some examples oi the parameters in which ive are inter 
ested are the distribution ot how the number of members^ 
of the population are distnbuted m relation to one another, 
the level of me<tsurement or how precisely measured the 
population isy and the variance or dispersion of the pop 
ulation of scores. 

In order to use a parametnc test ceHam conditions about 
these parameters of the popul^ion must bji met. Sincethese 
conditions are not ordinarily tes^ted they are as^sumed to 
hold^ The meaningfulness of the results the parametric 
test are as follows: 

L The population of scores must be interval level of mea- 
surement. 

2, The population must have norm distribution, A normal 
distribution is represented by a bell shaped curve ^/'""^ in 
which few scores fall at either extreme of the distribution, 
with a majority falling in the central portion of the distri- 
bution, 1 ^ 

3, All samples must come from either the same population 
or populations with the same distribution. 

4, All the scores tested must come from either the same 
population or populations with the same variance or dis- 
persion/of scores, 

A nonparametric test on the other hand does not specify 
these conditions for the parameters of the population from 
which the sample is drawn. Although one must assume 
when using most nonparametric tests that the observations 
(scores) are independent from one another and that the 
variables being measured have underlyingcontinuity; these 
assumptions are few and weak wher) compared to the par- 
ametric test. The nonparametric test can also be used with 
ordinal and sometimes nominal level data thus not re- 
quiring, such precise measurement (SiegaL p, 31), 

The parametric test is the more powerful test {sec the 
following chart). That is, it will reject the null hypothesis 
when it is false more often than a nonparametric test. The 
reason for this is that because you make more assumptions 
about the parameters of the population in using the test so 
that you have more information on which to Ijase your 
decision. There is less a chance of making a wrong decisiony 
and so you are free to reject the null hvpothesi^ with a 
smaller significant difference between the experimental and 
control measures. Howeven if you use the parametric test 
without making all the assumptions needed^ then your re- 
sults will be meaningless. 

The nonparametric te^t; although not as powerful is use- 
ful when one cannot make the assumptions necessary for 
using parametric tests. This is often the case when working 
with small groups in a classroom situation. Often the pop- 
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ulation of scort^s arc onl> ordinal or a^min;)! level of data 
and this too requires the use of nonpa ami. i< rMhQv than 
parametric test. In additiony nonparametnc methodii are 
more under&tandable^nd usuall) much (?asur lo appi) in 
theclassroom'tBerrtcs, pp. 75-78). 

For the reasons stated in the preceding paragraph, most 
of the tests found in this manual are nonparametric. 

Choose the most powerful method t^Lat is possibl^^ giv en 
your study design and the level of m.^asurement of vob^ 
data. The characteristics of each test level of measurement 
required; type of question answered, iiample problem and 
equation are listed on the chart on the next page. 

If your resdts are significant at the 03 level then you 
find support for your hypothesis and ^y reject the null 
hvoothesis. This means that there is only a 3 percent chance 
that your results were due to error or rhance. 



Assumptions of Parametric and 
Nonparametric Test 0>mpared 



Parametric tests. 


Nonparametric tcsis. 


Interval Jevel dafa. 


Nominal, ordinal or interval 
levd data ^depending on the 
lest. 


Normal distnbution of 
the population, - * 


, No particular shape of ihe 
distributiCpn needed. 


All ^mpleS must 
come from the same 
population or 
population wilh ihe 
same shape 
distribution 


Samples rnay come from 
differently shaped 
distributicfi 
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Matching the Reading Questions 
with Apiin»prl«te 
' Statistical Model and Methods 

Q. Is therea rflation»hlp betiv«en readii^ achievement and self* 

H. There\vi)l be a significant relationship between reading achiv\a>' 
mentas measured by the SRA Reading Achievement test and self- 
concept as measured by the Coopersmith Self-Concept Scale 
Model: Model 8 (Chapter 5) is chosen to find the relationship be- 
tween two scot«s for the same individual. 
Method; The Spearman Itank Method (Appendix 1.2) is used t^- 
caus4 the scores (data) wijl be measured at the ordinal level of 
measurement and you want to find the relationship between these 
two scores. 



Is there a relationship among readir^ achievement, self*con* 
cept and fear of failuie? 

Hp there wilt be a significant relationship among reading achieve- 
ment as measured hy the Metropolitan Primary Reading Achievt^ 
ment test, self-concept as measured by Bookovcr Academic Self- 
esteem test and fear of failure as measured by the Fear of Failure 
test. 

Model: Model 11 (Chapter 5) is chosen to find the relationship 
among three or more scores. 

Method; Kendall's Coefficient of Concordance (Appendix 1,2) is 
used because the data is ordinal level and you are comparing three 
or more scores. 



Q. Do children with dominance problems do worse in reading 

than children with normal dominance? 

Hp Children with mixed -dominance as assessed on the Penplieral 

Dominance test will have lower scores on the Sloss Oral Hvadint; 

test than children with JateraJ dominance. 

Model; Mode] 3 (Chapter 5) is used because you are trymg to 

determine if there is a significant difference between two groupf* 

which were not matched with only a post-test score 

Method; (chi-square) for two independent samples (Apt^ndix 

L2) is used because your sample was selected by independent (or 

random) selection and you are ^n^tng to find if there is significant 

difference between two groups' scores. 



Q. Will the higher-ability students or the loiver*abiltty students 
benefit more from participating tn an [ndividualized Reading; 
Program? 

H. Students of lower ability will improve their performance on the 
SRA reading comprehension lest significantly more than the 
higher-ability group. 

Model; Mode) 3 (Chapter 5) is used to determme if there is .i 
significant difference in performance between two different groups 
receiving the same treatment 

Method; The Kotmugorov-Smirnov 2-sample test (Appendix 1. 2) 
IS used t>ecause the level of measurement is ordinal and you aro 
trying to determine if the score improvement of the lowcr-abihty 
group IS significantly more than the higher-'abihty group. 



Q. Is an individual reading program more effective than a tra* 
ditional group reading program? 

H. There will be significantly more improvement in reading com- 
prehension, as measured by the Stanford Diagnostic Test when an 
individualized readir^ program is used than when a traditional 
group reading program is used. 

Model; Model 6 (Chapter 5) was used to test two groups receiving 
different treatments to find the significant difference. 
Method: The M a nn-* Whitney U test (Appendix 1. 2) is used for 
ordinalle vet data to find significant difference between two groups' 
scores. 



\our Personal Questions about matching Reading questions with 
appropnate Statistical Methods. 

1. 

2. 

3. 

4 

5 
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Do my students leam more using an individualized spelling 

Srogram (EX: Prete3t--Tteatment~Post*test)T 
L The students using an individual spelling program will improve 
their spelling scores significantly in a six-'month pt>riod. 
Model; Model 4 (Chapter 5) is used to determine if then' is a 
significant difference in your students' scores. 
Method; The Wilcoxon matched -pairs, sign*ranks test (Appendix 
t,2)i5 the best statistical method fo: ordinal Jevel data for related 
samples. (The scores compared are both from the same student so 
your sample would be considered a matched s^imple ) 
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Activity 7:1 



Processing the Data Checklist 



Yes No N.A. 



nkedvaii : 



Have I ranked.aii scores? 

Have I detenniV^^»d the level of measurcnnent of my data* 
Nomina) 
Ordinal 
Interval 
Ratio 

Are my groups of sublets related (matched)? 
Are my groups of subj^ts independent (randomly selected)? 
Check the design of my study? (see Statistical Model chart) 
Determined wh^it statistical analysis 1 should use given my study de- 
sign, level of measurement, and type of groups — related or unrelated/ 
and question asked? (see charts) 
Calculate my results 



NOTES: 



Additional Readings 



Easy: Dixon, p. 70, 89, 93, 299; Barnes, p. 46, 1% 78, 85; 
Runyon, p. 3, 37, 63, 109, 124, 207, 307, 339; Ferguson, p. 
1, 131, 179, 264, 275. 

Hard: Siegal, p. 7, 20, 21, 30; McNeinar, p. 14, 16, 19,39; 
Hayes, p. 81, 215; Andrews et aL, p. 3; Vallis, p. 213, 384; 
Galfa p 103; Slakter, p. 255, 265, 382. 
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step 8: 




Action Alternatives 



One (jf the expected outcomeb uf the ICPS moid ib tL> 
assist the leather in making dcastons ba^ed i^n available 
or intentionally collected information. The completion uf 
a study should have guided a teacher over the collection, 
organisation^ analysis and interpretation oi information re- 
lated to the problem to be solved. The only task remaining 
is to select among a varied arr^y of action alternatives. In 
shorts how are the results to be used to guide instructional 
activity? 

[t should be recognized that the utilization of information 
is^ in the final judgments a personal process Individual 
teachers acquire data in relation to their own needs^ con- 
ceptions and perceptions. Since the generation of infor- 
mation is to a large extent a personal process^ teachers as 
data users differ in terms of any variable one would care 
to suggest. Therefore^ the personal utilization process is 
enhanced by watchmg the teachers' perspectives ah prob- 
lem-solvers to those action requirements guiding instruc- 
tional decision making in the classroom. Taking into 
account the personal nature of data utdization. there are 
four general action alternatives that a teacher mtght con- 
sider at the conclusion of a problem-solving procedure. 

Conduct additional study on the problem or related as- 
pects of the problem. 

\{ the results of the study are msigciificant or reveal sig- 
nificance in relationship between variables, the teacher may 
be interested in doing additional study, exploring related 
questions, orgenerating additional hypotheses for the same 
questions. The teacher may want to change the typ^ of 
study from one of studying the relationship between var- 
iables to one of finding a significant difference between 
them. Additional study might also be directed toward de- 
lineating the source or sources of the problen;b defining and 
identifying the variables more precisely, or establishing the 
speafic interaction effects between selected variables. The^ 
results of a problem-solving experience should increase the 
probability of teachers seekir^g additional answers to sig- 
nificant answers to critical insUuctional problems. 

Review related research papers or articles on the prob- 
lem beic% studied. 

Often the results of problem-solving help the teacher to 
realize how complex a problem might be and how little 
(s)he knows about the problem. At that point, the teacher 
might turn to others who have been working on similar 
problems. 'Professional journals, information systems, Ir- 
braries and resource people can be used to expand the, 
knowledge of the teacher on selected topics related to the 
problems of immediate interest. It is possible that the prob- 
lem solver might find additional evidence that might sup- 
port or refute her/his resultsor suggest that other approaches 
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to solving the problem might be more productive and Ube 
ful. Reviewb of related btudics pro\.ide the teacher with 
additional knov^ledge to isolate and ^oke instructional 
problems more effectively. 

Study different instructional approaches. 

Along these same lines, the teacher sometimes finds 
reading in general or subject matter curriculum books that 
(s)he may glean some knowledge as to the various tech- 
niques involved in dealing with the problem. The teacher 
may fmd different types .of methodologies or procedures 
that can be adapted to the requirements of teachers working 
under different circumstances. This alternative could help 
the teacher generate other hypotheses and pursue new 
teaching strategies and improve general ability to teach. 

Share your findings with others. 

The fourth type of action alternative is to disseminate the 
findings to otjiers. This may include sharing information 
about the successful strategies for dealing with selected 
problems. The problem-solver might accomplish this by 
developing materialsr attending professional meetings, 
talking with co-workers, or writing articles. In a mor/ gen- 
eral way, the teacher can also put forth the problem-solving 
model as an effective way of matching problems with so- 
lutions or even show a more efficient modification ^f this 
model. Both types of dissemination require that the teacher 
present ixiformafion ma format that is comprehensible and 
concise. 

Instructional Changes Resulting From the Study 
The fifth type of action alternative is to implement specific 
instructional changes This might involve refinemenf df in- 
structional materials, and techniques of presentation ;As 
the problem-solver records the results of his instructional 
innovations, it is possible, to determine with greater ac- 
curacy the impact of an approach to teaching on the meas- 
ured performance of selected students As a teacher makes 
incremental improvements in current teaching practice, 
there is likely to be a deaded expansion of professional 
skills that has greater potency in affecting the achievement 
of children. 
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Acdvity 8:1 



The following are summaries of hypothetical studies. What action atternatu e would you use in the given situations^ 
C^st I (see p. 58) 
Question 

Tom Reed '-s doing 3 study to determine whother the disruptive tchifdron in his tlass like the token economy system 
he established in his classroom. Will his students like it? 
H}fpothesis: The disruptive students will like the token economy. 

Results: Using the Binomial Test he discovered that there were bi|;nifiLantl> more dii»rupti\ o students who like the* token 

economy than who didn't like it, \ 
Cotidusion: \ 



Case 11 (See p, 64) ^ 

Question: j 
John Stock wishes to find out if the two tests ho gives his class at the beginning and <?nd of every year measure the 
same aptitudes, 

Hy/pothests. There will be a significantly strong positive relationship between the scores obtained on the Woodstock lest 

and the Metropolitan Primary 11, 
Results: Using the Spearman Rho^ Mr, Stock supported his hypothesis that there'is a significantly strong relationship 

between the two tests. 
Conclusion: 
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Activity 8:2 

Steps In The Problem-Solving Procedure 



Date$ Completed 



Steps 



Data Needed 



fidetl 



1 1 \t kill tiM 



I v,tluium>; thv MfdH 
J>id J tuur tnuiHf' ii^n^: ihv 
r*u>dfP 

(Hild I uv tW miH^'t lor iin 

iv>u lo improve ihf qiMhtv o\ 
in\triiitLim lit im pupls^ 



lUv pr^TNrm ^itIvioj; im>dH^ 



Who ^ .1 fitted hv thr jnt^liU'm' 
VVho tdust^d tt' ^ 

h<it IS the ^Okil ti'r mi}^rovt^mojit^ 

Ht>\\ tjn i u^*' tht'v roult^ to niakt* Jt^jMon^^ 
Am I tmJij; diM.o\fr \^hi*tht'r ,x rddtn^fiship exl^ts lwtwt>fn two 
trtiit\ or stt^res' 

Am I tmn^ to di^t"o\rr M^rufiCfint ili<fert'nct> bo^wocn scores' 
Ci>mp4)rm^ piT^Ofmjnct' t>( two ^(xmps oi s^lb|^^:t^^ 
lt'^t\ twtT j;roup\ t>l MibjtH*^ tvfojf tht' trt'iil^m-nt, prtrtt'\t 
l^i'tfrnxmf uhfihtT om' s'^^^P Mih|t'<:t^ m(t> i«h' t.iiop^n^' mofv 

i^rtfn tlun jm^tht-r >;rotip 
C om^>.irf mtwf tluin two j;fouj>s iil \tibKit\ 
Uluii iMii^ tto I vv,jiit to im'JMire' 
K thvri' J ^kindcirdimi h^r th^it tmii' 
[Xu'\ thi^ im'j\tiri' tUi\ tr^iit ffki1i\t<K m ptipits k-vi^P 
lojt ^iv,iihhk* to mt*"* 

K It toil to^tK >n t^*rm^ ot timr jnd moni'v ' 

t>bwm tlu' mtormjiion m ; our ivtord^ tt^ tonipIt'K tKt* C [>l"^ 

'^un^nuri/t' thf ff\uli\ W }\ thf pt'ftt'ntti^t* o\ tiwW^i\-fi\MK-. tJO it\'^ 

Uim K pr^i^rjjiMioi on it Niuk-^hitt' mi.\i(i j^o, vtc ) 
UWn tindt<r iimjm\tiim^^\ vki'w ihv pri'UM .ind pi^1-t(M 

IVvnN' m tli'MH wli.it the trt\umt»iu vnkiik-J 
C fimpkk' Lhr C OI^S ih-irt 
Riok ,iH Lhi' Miiro\ 

[X'tt'fmmr ihr k uH or miMMi/vmi m Mumtml (>rdinji Jmm,ii ^od 
K,itio 

'\rf Mibif^r j;rou|>s nuuihod^ 
Aft' siibu\t j;rtuit^^ rjnti*^mK mO^^ tt^tJ "* 
\\\\M 1^ thi' \Uiii\tuMl tloi^fl ot m\ ^tud^ ' 
t iu>k tip iH)i^iLu>n\ tot tUc ,ippropft<iti' ti>\t 
V\xi^ ui Ciilut'^ trom vitur djt.i 

hi'tk tht7 Ji-tpTv^prhxit' thrift tt^ itt-LiTtuini^ ^ij;nitKtH\tv 
Did 1 ^TJp(xt^t m; Jn p^t|i^'\t\' 
Old I .l:1^vvl»r mv i]uv^tiiMi\' 

Shoijd I m.iintiiih mv pro^Mm' , 

StumU I moditv nu po^nmi' Hon' 

Slunjtd I implfim-iu .1 jti'tv pr^T^r^nr \\'h,ji"* 

Shoijl^l I M^l itp a nvv\ lupoihois jm^npK'mt'iit Jiu^thor ^todv"* 

\o ^t»\ \ isj \]Hntit probkros 

\iT i |S| \p\lhi ftM\iiIlS 

\iT _ ^ r\ _ _ \\\t\ not' 



_ . pkirmm^: 

_ . Vltttmj; methods 

S^U^tMij; ,^t(\lth'^ 

. ktt'niitv^iif; ^p^^^^u ln^l^^Kilon,ll proNvm^ 



uton' vvork\Uttj>^ 

M,iSv U*^^ ivtTrk\luFp\ 

iTuludt' rnori' lutiirnMtion m thv rn>iruM] 

SimphSv thf m^inihit 
_ Iru lutlf morr rxjmpk'^ in ihv vviirk\ho^i >md m<miMl 

Smd fUii hti'Mlutc jiuJ s*inipU' ^|ut'^tioo\ .ihiMd of timt' so tht* 
ttMjirr^^iin sLirt fomuilhilion ot problem K'titrv thi' v^ork\liop 

'^Mri tMrlu-r i*i thr mIhs^I vlmi 

. I l.uc mor\- (i'^'tlKHk tr^un tht? Ui>rk^hi>p Mjpt^r^ivtr^ 

SunpliK ilu' probk^m-^oKin); wifthtnl 

Olht'fy^ 
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Activltv 8:3 



Steps Completed Using The Problem-Solvins Model 



Actions Taken Steps 
Com. Not. Com. N.A. 



1. Identify the)>robl€m. 
a. Formulation. 

Evaluation. 

2. Formulate the hypothesis, 
a. Appropriate test or method for quantifying results 

3. Defining populattoi 
a. Obtain all information for the C D.P S 

4. Sampling procedure selected. j_ 

5. Problem-solving design decided. 

6. List d all procedes. 

7. Data processing. 

a. All scores and information are charted 

b. Determine statistical analysis lo be used 

c. Calculate results, 
d. Problem 'Solving decisioits. 

a. Did I support my hypolhesis^ 
Is there a significant relationship? y-v 

b. Did I find the ^inswer to my question' ^ 

c. Did I solve my problem' 

d. What should be my next course of action' ^ 
9. Evaluation and feedback. 

a Did I have trouble using the modet? 

b. CouJd i use the nrodel on another problem? 

c. Would I use the mod^l on another problem 

d> Did I find tite model valuable in helpmg provide quality instruction to 
my pupils? 



Additional Readings 



Easy: Dixon, p. Z Bnmes, p. 52, 108 

Hardi Walb. p. 2% Gilfo. p. 299; Slakter. p. 382. 
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This concludes the ICPS Model as a process for making systematic instruc- 
tional decisions. The material shown in the Appendix is intended to assist 
teachers who are planning to conduct a formal study and would like to apply 
statistical tests to decide whether observed differences a^p significant. It is en- 
tirely possible that teachers will need some assistance in using some of the 
information in the Appendix. Howeven the information is within reach of most 
teachers. 



Appesidix 1: 
Statistical Equations 



GLOSSARY OF SYMBOLS 

A Upper lcH*hand in a 2 ^ 3 tabic* number oi \as**s \ 

dbservcd in tlut <x\\ 

a Alpha. Level of significance ^ piuhabilj*\ oi a Type I (?m>r O 

U Upper right-hand ceU m a 2 x 2 table* number of cases 

observed in that cell. p 
^ Beta Power of the test - probabiljt)' of a Type II eiror 

C Lowef left*hand cell in a 2 x 2 table, number t>f case^^ 

observed in that cetl p 
C Contir^ency coe'fiacnt. Q 

Chisquare A rartdom variable wliKh^lbllows the chi-st|uare distnbu- Q 

tion^ certain values of which are i*hown irv Table C of the r 

Appen<^Jx. r 
A statistic whose value is computed from observed data r 
xr^ The statistic m the t nedman two-way analysis of vaiiamt' R 

by ranks. 

d, A difference score* used u^ the cf*se of matched pairs, 'Hv r ^ 

tained for any pair b^ subtiactim^ the scoa^ one mem ? 

ber from that ot the ott^er 
df De^^ws of ftwdom. s 

0 Lower nght*hand cell in a 2 x 2 table, number tif as*> 

observed in > tat cvU. 
D The maxrnium difference between t^'^ twi>oimuljtii.t 

tnbutions iri the Kolniogoiov*Sinimow h^t 
£^ Under H^^ the expected nu mber of eastern fth rr^wand the C 

fth column in a tes! ^ S^(X> 

f Frequency, i.e., number of cases 

F The F test, the parametnc analysis & vanaivce tr 

F^iX) Under H^, the pfoportum of ^^ses *n thepopulatHtn^l^jsi 

scores sum e^^ual to o*^ k^Sft than X This js a statLstK: jn the 

Koknogojov-Smimov k-si 
g In theMos^'S tost, the amount by which an observed value (t ' 

of s^, exceeds Jir - 2h, where w - 2h is the minimum v 

span of the ranks of the control oises / 
C, In the Cochian Q test, the total number o' 'successes" m / 

the 7th column (sample) 7 
ft In the Moses (est, the predeiennmi>d number of tottieine 

control ranks which are dropped fn>in each end of tlie T 

span of control ranks before s. is detemmned t 
H The statistic used in tfie Kruskal-WaHis one-^vay anaJysis i^ 

of vanance by mnks U 
Hf, The Tiull hypothesis W 

H, The altemabve hypothesis, theoperatn>naUlateme[it oMhe 

reseanch hyptithesis. W 
J A variable subscnpt, usually denoting nnvs ^ 

/ A vanablo subscnpL usually denoting columrts 

K In th« Kolmogorov-Snumov test, the number of ob^^rva- X 

hons wbch are equal to or (ess than X X 
In the Kolmogorov-Snumov test, the numifratur of D ^ 
L, In th« Cochran Q test, the total number i>f ^uui-sses iv\ 

the tth tow. 
p. Mu The population mean 

pt^ The population mean under //„ , . 

The populiitjon mean under //, 
n The number of independently drawn cas<?*iin a Single vim 

pie I 



*A11 tests were adapted trom biegtl bignev. Ntwi/Vraiju'/JTL ^iitti^fu.^ 
for the B^tavtomi Utetto^. McGnm^IM B<xik Co , Nt^v York, l^'V* 



Tlx^ total nuiTibvr of independ+^'^.J v driiwn iasej> UMid ui a 
statistical tes' 

Tn*' (.i^seA'ed numbtf t.^ses jn the jih nn\ and the fth 

cvilumn in a a:" t^-st 
Probability as^sooat^ viiih !he - urrence under H, of ^ 

value as extresni as oi txmik vm* ne than the obs'.rved 

value. 

In the buwjmial test, the profHiii: of '\M<xt^^:^"r 

In thebiorwjn^il test* I - P 

The statjstK used m ihe Ctvliran ^es' 

The number of run^^. 

The Pearson product :iit>ment cvrrt^labofi ooeffiaent 

The number of roivt in a \ x r tabic. 

The siitn of the ranks i:i tla^ ;th colum i or san ^y\Q 

The Spearman rank correlation aicffiaent. 

Tlx^ mean of several 

In tlit^ Kendall the sum of the squarestrf J deviations 

of the fi, from the mean value of R, 
In the Moses test, the ^pan or rar>ge of the ranks of the 

conlml cases 

In the Mo%es test, the span or r *gc of t^(C ranks of the 
soiitRjliases after castas have been dn*pped from each 
extreme of that range 

A "statistic in the Kendall r. 

in ;he Kolmogorov-Smimov teste, the observoo mmulatiw 
step hinctittn of a random sample of N observe iionr.. 

Jjigma The standard deviation of the population When a 
sMbscnpt IS jpven, standard error (.if a sampling dis- 
tnbution, for example, aU - the standard error of the 
sampling distnbutfon of U 

The vanarKe of the population 

Summntioti of^ 

Student's t test* a parametnc test 
Tile numbfM* of obs<*r\'aUorw in rtnv tied group 
In the WJtoxtm test, the smaller of the sums of like^signi'd 
rankii 

A connection factor for ties 
Tau The Kendall rank a>rrelation a>effitien! 
llie Kendall p^irtjal mnk correlation av/fiaent 
ThL^ siAt >tic m the Mann- Whitney test 
U - - U\ a tifansformrtjon in the Mann-Whitnoy 
tt^t 

The Kendall coeffiaent of cona>rdance 

In tlie hnomial test, tlk' niimbr.*r of cases in one af the 

^lups 
Any obser^>d sair^* 
The mean of a sample of observations 
Dfiation of iia^ observed value from when w ^ 1 ^is 

niinnallv distnbuted Probabilities ass^xiatcd under 

with the occiim^ncv of va(ues as extr^^me as vanous ;*s 

are giwn in Table A of tlw Appendix 

Thebinwimialctwfficient (;) - 7- — Table T of the 

{it - by 

Appendix givr> binomial a?effitients for N from I to 20 
l-adonal ^ NiN - l)(N - 2) I hirewimpJe 

■- mAmiW - 120 

0' 1 Tabli.*s b «t the Apfjendix fadoruils k>r N 
fr<im 1 to2l> 
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IX - Y\ TheabsoJoUrvahieofthediffijTvricebeh/wnXdnrfy That X = V Xist'qualloV 

is. th* ituint^nc^ value of \he diffeivna* n^g^T<i(*^.s X ^ Y X is equal or g^t^alvr thiin > 

sign. For examp*e, |5-3( = p- 5{ = 2 X^V Xis i>qual (a or (ess (han > 

X > Y X is g[^l«r than Y X V X is no( t\^iuil (o > 
X < y X is less than y 



Ttsl it Design Models 



Bmomial Tesl 



Treatment Post -test 



K olm ogor o v-Sm irn o v 
One-sample Test 

E Treatment Posl-test 



One Sample 
Run Test 



li:vcl of 
Mcasureirvont 



Tvjje of Question Answercf'. 



Table 



CltaiAt:tcrtsttcs 
of the Test 



in >arri>!o it 'iVkj\ I a 

spcnhcti in h^pothosi*^' /.X U<- 
bov* ilo Ivi:*^ l\\an ^irfs ir 

fvamples' 



T for facton.ib 

[) Uir HX) Miiltiplv 
b\ 2 (or .1 2-tai!i*d 
leM) 



Used rtorniniil level 
Jit*, vjitli discrete 
rjte^»<>ries Power 

li3V. when N 



Chi iHiuare lesi 


Nomin^il 


Is then; a s^j;riifHMnt difter\.-nce 


t tor X- \i.hert 


Used ieviTral 






berween evpeck-xi i;rt>Np 


df-K*l 


r;stegor(es, 20*^ of 






frt^iucncie:> »ind oWrved group 


K ^ i-imi>4?r Of 


categoric:* have a 


iij Tjeatmcii* Post-test 




frttju^ nf le^'' IX — Which levt-l of 


c iugtirHS 


fre4|ueney of 5 or 






questioning used most 


Tne greater X' is. 


more*. If frequency 






frequently m tiass'' Is tX u*it^d 


Ihe sniviller the 


lower, categories 






Mgnifjcantly mort* rhE>!i t^rhcrs^ 


. "obalvhtv thai 


mu^l ix* comhjied 






ii. *er*:cd fret^uenc^* 


It (S a goodness-of- 








ffoni the 


fu tc^t 








e\;^rt Jed fret|ut*ncy 










f>opulatKin 





Norniiiial and Is fl>-: djeej^^ente be*\ wr. a 

C'rdinai theoretical and an ob^^rved 

distnbiitiuh due to cli^irtce or ari* 
(liey from dif/ereni populations' 
rx Does A child from a high, 
medi*j(m. of oconomit status 
hflvt* J s^gnificantK higher drop- 
out rale^ 



fc f*>r D ^fora 2- 
Miled teM) 



The test can t?e 
used for categories 
having eery low 
freqUettcy (few 
subjects in each 
category) It m a 
more fowerfui lost 
than chi square. 



Nammal 



Is djstfibiitmrt rand*?nilv 
selected? many runs (or 
identicd scoies appearing 
ftmsecutrvvlv>-«r<' jo sampk*' 



and f„ for tht- 
IjmUs between 
w'hich r nuist falL 
If r fails al^oee or 
below limiK, then 
sample is biasett 



Ihis lest js used to 
determine whether 
a sample is really 
randomly selected 
If r falls above F,i 
or beknv F, then 
the sample is 
biased 



Two R«l«ted Stttnples 



T^t^ Design ModeU 



Uvel of 
Measurement 



Type of Quesliort Answered 



Table 



Characteristics 
of the Test 



McNear Test 

- Pre- T . ^Post- 
E (est Treatment 



Nominal 



Is there js a si^nifieant 
difference between pretest and 
post-test scopes? CX Is 'Jiere a 
si^nifK'V * improvement in test 
score* en ciral instruclKins 
mstekia of written instructions 
are given' 



Degrtvs oi 
freedom = I 



If the expected 
frequencies of the 
sample are small 
use Binomial (est 
inslead of 
McNemar 4 + D 
must equal 6 when 
vA + Dt6 
power =^95*^ 
ASA+ D gets larger 
the power declines 
to 63^^ 



53 



ERIC 



Sign Test 



E test Tfcalm^^nt 



Ordina! within Arc there significantly mort^ ur D kir P (2-taik^ 

pa^r^i fowt^r plus si(5ns ihcn minus toM) A ior Z score 

Signs' rX Wdl children'v scort^s (for largo samples) 

on spelling tests increase or (]*tailed test) 

decrea^^ if they have time to 

study their words 

Lndt'pendently durtn^ class' 



Use this test when 
you can not rank 
T^^Lthe scores but 
you can judge the 
greater score of a 
pair This test 
measures the 
direction of the 
diff<?rence wit hi 
the pirs 
measured. Wh^ 
N = 6 the power of 
the test is 93^, but 
as N is larger the 
power of the test 
decreases to 63% 



hilt 
hin 



Wtlcvxon Matched 'Pairs, Sign 
R^nk Test 

Ellf^l Treatment ';^^|* 



Ordinal 



h there a significantly greater 
increase in the frequency and 
the magnitude of the positive 
values in relation tu the 
negative values? EX. Are 
children who attend nursery 
school more socially perccptiw 
than their matched peers who 
do not attend nursery schoul 



GforTO and 2 
taileiJ test) 



For thtS test you 
ne«d a continuous 
distnbution. Since 
it utilizes more 
information, the 
Wtlcoxon IS a more 
powerful test than 
the sign test, its 
power equab 95% 



Randomization Test 



t Pre-T . . Post* 
t t(>cit Treatment ^^^^ 



interval 



What IS the exact probability 
under the Null Hyp uthesis that 
our observed data has occurred' 
EX What IS the probability that 
20 students in SO would have 
1 Q of 120 or above ' 



When N ^ 12 A A continuous 
for Z distribution is 

necessary to 
perfom^ this test, 
but you need not 
assumq^ tliat you 
have ^^nonn^1 
distnbution^ Vii^ is 
one ofthe moi>\ 
powerful 
non para metric 
V tests. It Is UrttCr to 

^ use the Wikoxom 

Test If N > 1?» 



Two Independent Samples 



Test 



Level of 
Measurement 



Type oi Question Answered 



Table 



CharjtderUtks 
of the Test 



Fishcr Exact Probability Test 

E Pre* Treatment I Post* 
C test Treatment litest 
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NumiDdl or Do ^roup I and j;rvmp II differ 

Ordinal significantly? LX Di> children in 

a segregated classruom br I:M11 
differ m achievement from 
children also classified bMil 
who are mainstreamed' 



SforfaUonal(N^)1 
for significance oi 
P 



This test IS the 
most powerful one 
for Nommal or 
Ordinal level data 
Use it when N is 
small (A + B 15 
C + D 14) and 
when the data fits 
into two discrete 
ca tegones 



Chi Square test iot Independent 
Samples ^ 



Nominal 



Do two j;roups t(i(k*r wiih 
n*3pect to onv^ iharactv^rmtic^ EX 
Do hn^Ui or dull ^tudimt^ show 
mt>rt improvement academicdllv 
m a hif;hly structured progrtim 
or in ;in open dassn^om' 



C hr X' 

If X' - C \Mlue that 
it ^\ Mj^nihcant 
df-tr-lKk'1) r = 
no of cKissificatrons 
k - no of |;roups 



Use Chi square 
wh^n20N40 if 
expected 

frequenaes are 5 or 
more/ use the 
Hisher test if N 20 
or the expected 
fr<^quency is less 
than 5. 



Mann- Whitney U Test 



E, Pre- Treatment I Post- 
E, test Treatment II test 



Ordinal 



Have two independent j^roup^ 
been driiwn fr^im (lie same 
population' tX Dt> children 
uith dominance pr^iblems have 
more lr<iuble reading; than 
children with lateral dominance"^ 



j for3<n'<8 
Khr 9<n'<20 
n- - largest j;roiip 
to find U 

When n'>20 use A 
forZ 



nA 



This IS a very 
pciverful test. Use 
Lt as An alternative 
to the t-test when 
the data is only 
Ordinal lo^el or 
when the groups 
are unequal. 



Randomization Test for Two 
Independent Samples 

E, Pre- Treatment I Post- 
E> test Treatment II test 



Interval 



What is the significant 
difference between the means of 
tw^o independent samples when 
n^ and n^ are small^ 
IX Are group A's scores from a 
differL*nt population then grt>up 
B's scores? 



T for {-^) 
B/or T-test 



This IS ihe most 
powerful non- 
parametric te^t oi 
central tendency. 
Vou do not have to 
assume a normal^ 
distnbution or 
homogeneity of 
variance when n, 
and nj are large, 
the Mann- Whitney 
U test would be 
more effective than 
the randomized 
test and should be 
u3ed 



K-Rct«t«d Samples 



Test 



Level oi 
Measurement 



Type of Question Answered Table 



Characteristics 
oi the Test 



Cochran QTest 

E| Treatment 1 
Pre-' Post. 

E| Treatment 2 
test test 
Treatment 3 



Nominal or Do K-related samples differ C br Qdf=K-l If 

Dichotomized significantly among them^lves"^ C- Q then Q is 

Ordinal EX. I3 there a difference sigmfioint di'KA 

between three matched group* K = numb^^r of 

which receive three different categones. 
types of mst ruction? 



Use this test only 
for nominal or 
dichotomous data* 
If N is too small 
the results will no 
longer have the 
distnDution of Chi 
square. 



Ffiedhian Two-Way Analysis of Ordinal 
Varience? 

E] Treatment 1 

Pre- Post- 
Treatment 2 

test test 
E, Treatment 3 



Were K samples draivn f'Om 
same population? Do rank totals 
vary significantly? £X Do three 
groups of students' achievement 
scores differ with three different 
type*^ t teaching techniques? 



ChrXr df^K-] 
If Xr^ ^C then it is 
significant N for 
Xr* when 
K = 3n-2-9k = 4 
n = 2-i 



This test iS very 
powerful It should 
be used in 
preference to the 
Cochran Q 
whenever the data 
IS appropnate 
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0') 



Tesl 



Lewi oi 
Measurement 



Type of Questions Answered Table 



Characteristics 
of the Test 



X^for K 

Independent Samples 

El Treatment 1 
Pre- Post- 

Ej Treatment 2 
test test 

C Treatment 



Nominal or Are samples from same C for X* di - (K- 

Ordmal population^ EX Will children I){r-1) K = number 

with parents who have different of columns 

levels of education read the r= number oi 

same number of books outside rows 
of class for en^oyment^ 



Limit the number 
of groups. When 
theic IS more than 
I group> the Chi 
square test is 
insensitive to 
order. K or R must 
be greater than 1. 
And m t^t the 
categories must 
have an expected 
frequency of S or 
more 



Kruskal-Wa^ 

OncjWa^Ana lysis of Varience 
E, Treatment I 

Post- 

E; Treatment 2 

test test 
C Treatment 3 



Ordinal 



Are K samples from the fame 
population with respect to 
averages? EX Do children from 
different Soaoeconomic classes 
achieve significantly different' 
grades m school? 



OforH 
df = K-l 

For large N uSe C 
for H 



This test requires a 
continuous 
distribution. This 
test has9S%of the 
power of F test 
(the equivalent of 
the parametnc test). 



CorreUtions 



Test 



Level of 
Measurement 



Type of Question Answered Table 



Characteiistjcs 
of the Test 



Contingency 
Coefficient C 



Nominal 



Sub- 






ject 


Read'g 


Math 


# 


Score 


Score 




70 


84 


2 


75 


83 


3 


84 


73 


4 


80 


79 


5 


81 


83 



What IS extent of association 
between two attnbutes? EX. 
htow much relationship 6 there 
between oral ability and writing 
ability? 



CforCdf = (K-l) 
tr-1) 



This test has the 
same limitations as 
X^ In that it is not 
very powerful but 
sometimes it is the 
only alternative. 
Also you can't get 
a perfect correction 
(can approach it 
though with a 
larger N) 



Spearman 
Rank 

Correlation 
Coefficient 
Rs(Rho) 



Ordinal 



ICendall Partiat 
Rank Correlation 
Coefficients lau xyz 



Ordinal 



Sub* 


Corrt*- 




ject 


lation 


trait 


# 


^ J 




1 


90 93 


91 


2 


8S 90 


86 


3 


89 91 


95 



Are individuals ranked similarly 
on two characteristics^ £X Do 
children who score high in 
Matli also get high scores in 
Reading/ 



P for rs (l-tailed) 



This test IS 90% as 
powerful as 
Pearson rYoduct> 
the comparable 
parametric test. 



Is there third 
viable causing 
corrf 'lation between 
Xand y? CX Can 
level of parental 
education rnfui^nci^ 
relationship 
between ■ 
achievement and 
Socioeconomic 
status^ 



Q for lau xv^ if N:-'10 use A for 
Z 



There is no test of 
^gnificance for this 
test t>ecause the 
distribution 6 
unknown. Use this 
test to control for 
variance when you 
cannot control for 
outside factors in 
the study 
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Kendall Coemci«nt 
of Concordance^ 
W 

Sub- 
ject 
# 
1 
2 
3 



Ordii 



Trait 


Trait 


Tratt 


Scofi? 


Score 


score 




iy) 


Z 


15 


20 


23 


21 


13 


16 


14 


17 


18 




What is dtigrt't? of vananct? 
^mong several (K) rankings of N 
objects or individuals^ £'X Mow 
close IS the mterjudg^ 
agreement on ranking children 
in a class wording to 
disruptive behavior? Ordor 
f^ntities according to consensus 
and clusters of variables 



R for W 

3^ K =£ 20 

When N> 7C for 
X^df"N-l 



This test measures 
civergence of the 
actual agrei^ment 
v/ith perfect 
agreement. A 
5ignific<int W 
neans Judges are 
using the same 
cnteriano judge 
litis dees not sell 
whether the criteria 
i> the right one ^ 
^rtth which lo 
judge subjects. 
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Ai^pendix 2: Sample Studies 



Bieontnal Test 

The Binomial is a gooJnt*ss of-fit ii^t It is ust'fu) in vlt'tt^rmming 
whether ibisroasonabk to believe that the portions (or fix^uenci^s) 
within a given sample coM have been drai\n from a popuJattun 
having a specified value of P. is the proportion of cases in ont 
class vnthiti a population. The data must be nominal level and 
separated into two discrete categories such as male and remake 
in-school a^d out'Of-schooL member and non^member. There is 
no compara^e pa^ametrK test which is'applicble to d^ta n^?asured 
at the nominal level- However^ wKcn tht* relative' power of the 
Binomial test wasmeafured, the results showed it to have 95^ of 
the power of a paramenc (est to reject tht* null hypothesis when 
N-6, As Njgrew power went down to 63% 

Tom Reed is doing a study to determine whether thv dtsniptive 
children in his class like the token economy system he established 
in the dass, (see p. 47) 

1 Null Hypothesis: There wtll be no difference between the 
number of disruptive students who like the tokt*n economy 
and the number of those who don't. 
Hypothesis; The disruptive student will like the token econ- 
omy 

Statistical Test: 

ii The binominal test i^ chos^'n because thi- Jata are tn twu d^^ 
Crete categories (disruptive nondi^ruptKUj and the dt^^i^n ^> 
of the one sample type {Um v>nl) asks tht* pupil pr^^tt'ivn^v 
orKe). 

III Signifrcance LeveJ: Let probabiit}- E;5, N ^ iht numbt-r ■! 
diw^ipnve students 10 

IV Data 



Names 


Disruptive 


N on- Disruptive^ 


John 






Susie 






Fred 






Larry 






Mary 






Tina 






Tom 






Kathy 


V 




Dan 






Pam 






Bill 






Terry 






lean 






loan 






Rob 







Disioptive student = N 10 N ^ tO 

P = the t*xpocted number of disruptive stu* 

dents who like the token economy oc- 

curnng by charKe. 
Q 2 10 disruptive Students - P 

^' The Equation if ) PjQN-i 

i = 0 

Table D gives the probabilities associated with the occur- 
rerwe under the Null Hypothesis, 
vi, Reje<t[on region; Me will find support for his hypothesis if 
the number of disruptive students who don't Uhc the token 
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economy is so small that the probability of that number of 
students occurnng under the Null Hypothesis is equal to or 
less than P ^ 05 
vii Decision, Onl> one of the 10 did not like the token economy. 
Looking up in Table D wjth N - 10 and X = 1, we find P 
= on Since 0)1 05 the hypothesis is supported Mr 
Reed's students did enjoy using the token system. 



Chi*Sqnarc Two*S«inpl« C«s« 



This test IS used to compare the numf>er of scores in two or more 
categories with the expected mimf>er pf scores in those categones, 
based on the null hypothesis. This goodness-of-fit-test can used 
with nominal level data- There tS no informahon in the literature 
as to the powec of Cht^square to reject the false null hypothesis. 
However it is suggested that if the stahstiaan's data is ordinal 
level or higher, the KolmogofoV'Si^irr^ov or some otne^ test f>e 
used because they use more informahon and therefore would have 
more power to reject the null hypothesis. 
Example 

Helen McBride felt that her second graders who were read to by 
their parents en|oyed reading more than those whose parents dtd 
not read to them. Some of her students's parents dtd not read to 
them but had allowed their children to attend Story Hour at the 
hbrary. Helen decided to Hnd out if there was a difference bet ween 
th(^ three groups preference for reading 

I Hypothesis; The students whose parents read to them will 
have a higher score on the reading enjoyment test than those 
whose parents do not. 

Null Hypothesis; There will be no difference in reading per* 
ference amonj? the three groups 

II. Statistical Test; The Chi Square test is chosen because the 
data is categoncal or nominal level of measurement and be- 
cause Mrs. McBnde wants to compare a theoretical dtstnbu- 
tion with the distnbutton of scores which actually occurred. 

Ill Lev'el of Significance; Let a (alpha) =^ 05. N 30 students. 

IV. Computation Data 





Parent read 
to children 


Children attend 
Library hour 


Children not 
read to 


Total 


like to 

read 


Lxpected 5 
(under the 
null 

hypothesis) 
Observed 9 


5 


5 


15 


don't 
like to 
read 


Expected 5 
(under 

rtulDObserved 1 


5 
4 


5 


15 


Total 


10 ' 


10 


10 


30 



Equation 

= Chi squAK 

0 = observed scorts 

E = expected scores 

1 y 

22 ^ add the sun 
. (9 - 5)- ^ (6 - 

. <8 - 5)! 



, 16 1 9 16 1 9 52 
.1 = 10.4 df - 'r I) :;v - 1) - (2 



f ^ach ce!l 



5)- ^ (I 



5)- . (4 - 5)- 



- 1) 



no - 1) = 2 



3. ConsultTableC, df = 3 5,99 ^ cnhca) value of ChhSqu^ire 
V, Region ot Rejection; in order to reject the null hypothesis^ 

Mrs, McBtide must have 5,99 or more, 
vi. Decision: Chi*Square m ]0,4whichisgreaterthan5.99,There'- 
fore> Ms. McBride may reject the null hypothesis at the .05 
levei. She finds support for her hypothesis that the children 
who have someone read to them will enjoy reading more. She 
decided to start reading aloud to her class. 







Educa- 










Tradi- 


tional 


Library 






Names 


tional 


Comics 


Time 


L t 


L2 


Tod 


0 


0 


0 


0 


0 


Anru 


0 


1 


1 


2 


4 


Sue 


0 


' 


0 






Kenny 


0 


0 


0 


0 


0 


Steven 


0 


1 


0 






Mane 


rt 
t! 


rt 

t! 


1 

1 


1 
1 




Mike 


0 


0 






1 


Barry 


0 


j 




2 


4 


Lenore 






I 


3 


9 


Kathy 


0 


0 


1 


! 




Craig 


0 


0 


1 




1 


Terry 




0 


1 


2 


4 


|ohn 


0 




0 


1 


1 


joey 


0 


1 


1 


2 


4 




G, = 2 


G. = 7 


G. ^ 9 


L, = IS 


V ^ 33 



V, Computation 

. (k-l)lki:G/-aGj^] 

k2 - 2 L ■ 
<3- l)3(4-H9V^l)-<18j 

{3K16) - 33 
23034) -18 

^ " 54-33 
Q = 36,57 > 



^ 2! 



Cocbratt Q T«st 



The Cochran Q tests for significance difference among three or 
more matched sets of data that are at the nominal or dichotomized 
ordinal level of measurement. The test can be used to compare the 
same su^^jects under three or more conditions^ or three or more 
different sets of subjects under the same condition. The power of 
this test Is not known^ however the fact that it should be used with 
nominal or ordinal level data^n^^escompanson between the Coch^ 
ran Qand parametiic tests meaningless, Tarametnc test must have 
interval level of measurement. The statistician is cautioned^ how- 
ever> not to use the Cochran Q if the data is interval level of 
measurements as some of the information may be wasted 

Example 

Mary Stewart was interested jn finding out what teachiiig 
method would increase reading enjoyment for th^ children in her 
$th. grade Titlel reading program. The three methods she employed 
were as follows: 1) a traditional round*robin oral reading approach; 
2) educational comic books were used in class as supplementary 
reading materials/ and 3) time was provided duhng class to go to 
the litory for selection of books, Mary would like to know if there 
IS any difference menjoyment for the three methods of instruchon 

The following is an outline of Ms, Stewart's study: 

1, Hypothesis: There will be a significant difference of reading 
enjoyment for the three different methods of instrudion 
Null Hypolhesisi There will be no difference m the reading 
enjoyment for the three methods, 

ii. Statistical Test: The Cochran Q i& chosen beause th(* dataare 
for three related groups and a:e dichotomized as yes and m 
reading enjoymenL 

ti. Significance Level: Let a (aip^ia) ,0K N ^ 14 (Mudent^) 

vL Z>aU 0 = no enjoyment I = enjoyment 
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3, Consult Table C, with df = k^l = 3 - I = 2 
The figure under ,06 column in row 2 = 5.99 

VI, Rejection region; One may reject the null hypothesis when 
the value of Q is larger than the figure hsK^d for tho signifi- 
cance level of ,05, 

vi. Decision: Since Ms, Stewart's data yielded a Q - 3657 which 
is larger than the necessary 5,99 for significance at the ,05 
level she can reject the null hypothesis. She finds support for 
her hypothesis that there is a significant difference among 
methods of teaching for increasing reading ertjoymonL 



Contingency Coefficient: C 



The Contingency Coefficient C is a measure of relationship or 
the extent of association between iwo sets of attributes It is the 
only test of its kind for data which is nominal scale> that is of 
unordered senes of frequencies. This test ts not powerful in re^ 
lecting the false null hypothesis, but ts uniquelv useful with its 
ease of computation and freedom from restnctive assumptions 
about the popubtion. 

Example 

John Stock felt that there was a relationship between law achtcve 
ment and disruptive behavior He wanted ta determine tht; 
strength of thi^ relationship in his fifth grade Mudcnb This port 
of his study follows: 

I, Hypotherls: There will be a significantly strong positive re 
lationship t>etween the low scotes obtained on the achieve- 
ment test and ratings of disruptivertess^ 
Null Hypothesis; There will be no relationship between low 
achievement and disruptiveness, 

ti. Statistical Test: The Contir^ency Coeffiaent C was chosen 
because the data of one of the variables was categorical (dis^ 
ruptive/nondisruptive) and also Mr Stuck was st.eking to dis- 
cover the strength of the relationship, 

59 



iiL Level of Significance—Let a (oJpha) 
iv. CompuUtion 
Data 



.05, N = IS students 





Below 50 


Above 50 V 






Pefcentile 


Percentile 


Total 


Disruptive 


5 8 


5 2 


10 


Non disruptive 


3 2 


3 4 


6 


Total 


10 


6 


16 



Equations 



1. 



El 



5) 



= add the sum ot differences of 
t Mch celL 

Oi, = observed number of cases 
in a cell. 

Ei, = expected number of cases 
in a cell all chances being equal 
(2-3) ^ (4 - 3) 



4 26 




C - contingency coefficient 
= value of x^ for data 
number of subjects 



N = number of si 



m 

46 = 5 

Consult Table C. .46 is significant at .S level 

Rejection region; The nulJ hypothesis will be repccted C = 

.05 signiHcance or less 

Decision: Since C was not significant at the 05 level. Mr 
Stock can not reject the null hyj>othesis Therefore, Mr, Stock 
does not Hnd support for his hypothesis that there is a sig^ 
nificant reiation&h^pbet^eendisruptncne&sanJlavk ai^h^^^i.^ 
ment. 



FUher Exact Probability Test 



This test IS used to determine if one of two independent samples 
has significantly more scores in one of the two mutually exclusive 
categories lhan the other The two groups must be small in size 
and be measurable at the nominal or dichotomial ordinal level The 
Fisher test is the most powerful one a teacher can use on data that 
meets these specifications 

Example 

)oan Mitchell noticed that the children in her fin^t grade tlass 
who seemed least well adjusted were also the youngest children 
chronologically. She wanted to discover if there was a significant 
difference between the adjustment ratings bet^^'f^en the group of 
children whose birthdates fell between October 1 and December 
I and those born in other nwnths An outline of her study follows: 

Hypothesis: The children bom between October 1 and De- 
cember 1, 1972 will be rated as having ad|ustment problems 
significantly more frequently than the other group 

I. NulJ Hypothesis: Ther^ will be no difference m adpustmerit 
ratings tit ween the tw6.groups. 

ii. Statistical Test: The Fisher Exact Probability Test was selected 
because the catagories— adjusted and malad|usted— are rr-i- 
tually exclusive, and since the N is smali. 

lii. Data 

A d pusted Ma la d j u sted 



youngest children 
older children 



A I 


B 8 




D 0 



60 



8 15 



Computation 
t Refer to Tablet 

2 A+B = 9 C + D = 6, goto this row under Totals in 
the Right Hand Margin 

3. B = 8, therefore go to 8 under the B (or A) column 

4. D = 0, therefore go across the 0 to fmd the level of sig^ 
nificance, which is OA 

Rejection Region: The null hypothesis will be rejected if D 
= a .05 

Decision: Since D = 0 which is less than the 2 ncede<l for 
significance at the 05 leveh Mrs. Mitchell's hypothesis is sup- 
ported. She can reject the null hypothesis. She can therdore 
conclude that there was a significant difJerence m adjustment 
between the two age groups. 



Friedman Two*Way analysis of Variance by 
Ranks 



The Friedman test is to be used to determine if three or more 
samples differ significantly from one another and thus come from 
different populations. The samples must be matched and be meas* 
urable at the ordinal level of data. This matching may be actueved 
by studying the same group of subjects under three or more con- 
ditions or by assigning matched groups to the different conditions 
Although the exact power of the Friedman test is not reported, 
Friedman compared the results of his test with the results of the 
F test, a parametnc test, and the companson shows the Fnedman 
statbtical test to be equally as powerful as the F test. 

Example 

John MtGee was interested in distovenng which of three meth- 
ods of teactung was most effective in helpmg his fifth graders to 
learn vocabulary words. The first method he tried was to have each 
child look up the definitions of the words only. In the second 
method, he divided the children into groups with each group giv- 
ing a report on the etymobgy of each word The third type was 
to have the students Ante stones usmg the words. His study fol- 
lows: 

1. Hypothesis; Theie will be significant difference <tmong the 
group's performance under different conditions 
Null Hypotehsis; There will be no significant difference 
among the treatments. 

II Statistical Test: The Friedman Two-Way Analysis of Vanance 
was used in this case because the data was ordinal level in 
measurement with matched samples 

jii Significance Level: let a ^alpha) = 05. N - 9 (the number 
of students in Mr McGce's reading class) 

IV Data 



Nanies 


Scores 




Defi' 




Ety- 










nitions 


Ranks 


mology Ranks 


Stones 


Hanl^s 


Mary 


5 


1 


8 


2 


9 


3 


Creg 


t 


2 


9 


3 


7 


1 


Tom 


7 


2 


6 


I 


9 


3 


Renee 


6 


2 


7 


3 


5 


I 


Tony 


S 


2 


9 


3 


7 


1 


Ray 


8 


1 


10 


3 


^ 


2 


Ann 


9 


3 


8 


2 


7 


1 


Rjck 


5 




9 


3 


8 


2 


Martha 


10 


3 


9 


2 


7 








17 




20 


R, « 


15 
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Computalton 



I Xr 



12 



:(r,)^ - 3Ntls + I) 



Nk (k + I) 
N = number ol rows 
k =^ number of columns 
K = sum oi ranks in each individual column 
X ^ directs one to sum the squrcs of the ?ums of ranks 
over all three teaching methods 

(289 400 + 225) - 3 (9) (3 + Jj 



2 Xr^ ^ 
Xr^ 



9 (3) (3 + 1) 
108 



] (806) 
Xr^ = 88.66 

Consult Table N where K 
Significant at the .05 level 



3 N = 9 
6 22 = Xr^' 

Rejection region: The rejection re};ion for the Null Hypothesis 
of all values of Xr^ which are so lar^e thot the probability 
associated with their occurrence under the null hypothesis is 
equal to or less than a (olpha) = 05 (6.222) 
vii. Decisions: Since the Xr* = 88.66 is considc^robly larger tlian 
the 6.222 to considerably larger than the 6.222 to find signif- 
icance at the .05 level, Mr. McGee finds support bis hypoth- 
esis. He ^an reject Null hypothesis, that ;^\\ iUa trootments 
help his students e^jually. 



KendftU Coefiicicitt of Concordance: W 



The Concordance W is used to me^isure corrdation or strength 
of r£ lotions hip among three or more sefs of scores/ Such a measure 
may be particularly useful in studies of inter^test or inter-|udge 
reliability or in studies of dusters of variables. A high or significant 
value of W may be interpreted as meaning that the tests or |ud^os 
are applying the same standards in ranking the variables undt^r 
study. Clusters of variables are studied in the e>;omple below 

Example 

Mrs Dema fane Martin had the idea that some of her stujent*; 
felt that the work she assigned was too difficult to perform, there^ 
fore they didn't even try to listen or make their best efforts She 
wants lo fmd out if there is a relationship among the variables lack 
of self-esteem, reading comprehension scores and fear of failure 
scores. 

I. Hypothesis: There will be a significant stronp relationship 
among the three variables, self esteem (as measured by the 
Self-Esteem questionnaire), fear of failure (as measured by the 
test of that same name) and achievement (as measured by the 
SRA Reading Comprehension Test). 
Null Hypothesis: There ^iH be no significant telattonship 
among the variables. 

li. Statistical Test: The Kendall Concordance W was used in this 
study to find the strength of relationship among thret^ vari- 
ables and the data is ordinal tevel in measurement 

ill. Stgnificance Level: UA a (alpha) 05. N = 15. 

iv. Computation 
Data 







^eih 


Pear of 












Esteem 


Failu re 






bt udent 


nanK 


nan^ 


ivanK 


D 
1\ 


Debbie 


12 


14 


12 


33 


13 73 


l$8,51 




3 


4 


4 


M 


- 13 27 


176 09 


Patrick 


2 


6 


3 


II 


- 13 27 


176 0^ 


Alien 


II 


10 


g 


29 


4 73 


22 57 


Stex-e 


13 


12 


14 


39 


14 73 


216 97 


Alice 


1 


3 


5 


9 


15 27 


233 17 


Willi;) m 


7 


6 


7 


20 


4 27 


\S 23 


Pam 


8 


9 


10 


27 


2 73 


7 45 


Terry 


10 






27 


2 73 


7 45 


Joan 


4 




2 


7 


17 27 


298,25 


Mi^e 


14 


13 


13 


40 


15 73 


247 43 


Fred 


5 


2 


1 


H 


16 27 


264.71 


Marty 


6 


. 7 


6 


19 


5 27 


11 Tl 


Sue 


9 


15 


15 


39 


14 73 


Z\b97 


Kevin 


15 


13 


12 


40 


15 73 


247 43 






24 2 










N 


N 







2348 S9 



Equation 



W =- 



-2(R, 



'sum of observed deviations from the mean 



I/l2k'(N'' 
of K = 2348.89 

k = number of sets of rankings ~ 3 
N - number of subjects (students) - 15 

2348 89 



W - 



1/12(3)M15'' 
2348 89 



15) 

234S 89 
2520 



W 

X 
X 



UJ2(9) 0360) 

.932 Since N 7 fmd (chi square) 

' = K (N-l) W 
= 3(15 - 1).932 
= 39.144 ^ 

df = N - 1 = 15 - 1 

Consult Table C. (If N 7 consult Table 1^) af - 14 
Critical value for .05 23.68 

Rejection region: In order to reject the null liy pothesti> x' must 
be equal lo or greater than 23.68 

Decision; 39J44 is greater than 23.68, thtrtfore Mrs Martin 
may reject the null hypothesi*} ot the .05 level of significance. 
She finds a significant relationship an^ong the three variables 
of achievement, self-esteem and fear of failure 
'The data must be ordinal or ordered in le\H of measurement 



KolmogorovSmjntov On^^-Sample Test 



This IS a goodness- of ^f It test It is used to determine the degree 
of agreement between the distribution of a set ol sample values 
(observed scores) and some s]>ecified theort*tical distribution The 
Kolmogorov-Smirnov test is useful with ordinal or ordered level 
of daia, particularly if the number of sccres in each category is 
small. This test is more powerful than its counterpart thechi^square 
test in rejecting the null hypothesis when it is false, so the statis- 
tiaan has a better chancf of getting significant results by using the 
Kolmogorov-Sniihiov test than by using the chi'S<)uare lasX 
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Example 

JohnStock's 5th grade Mudtntsdri^ cb^^ifit'^ tis hj\ in^ Uiwl si 
language arts ability oi all fifth graders in xUv school Most of these 
students have be^n in thi^ low grouping throughout grade slKuuI 
Many of them have also been discipline problems thr^mghnut their 
grade school days. Consequently,, hhn as mstituttd ^ piunt b\ sttm 
to try and improve the disopline in his r^wm He ^^ant& to find 
out if the class likes the pomt system, so he administered a ques 
tionnatro to his students. His study folkiws. 

i. ' Hypothesis; The students Will rate the piunt system signili- 
cantly highly as measured by the questionnaire 
Null Hypothesis; The number oi stirdents ivho rflte the [Joint 
system high will equal those v^rho rate it hm. 

\u Statistical Test: The statistical test v^rhich is appropriate to test 
this hypothesis is the KbImogoroV'Smirnov test because the 
data is of ordinal scale and it is aimpared with a thei>retical 
distribution. ^ 

111. Significance Level; Let a (alpha) = .OL N 20. number ot 
students. 

iv. Computatfon 
Data 



/= number of subjects 
choosing rank 


Sco 
erei 

1 


re o 

iCC) 

2 


3 


lesic 
4 


mna 


ire( 

6 


10 = 
7. 


^ hij 

a 


9 


ref- 
10 


0 


0 




0 


2 


4 


3 


2 


4 


4 


f,(X) = theoretical cu' 
mulative distri 
bution under 


10 


2 

10 


3 
10 


10 


10 


6 
10 


7 
10 


8 
10 


9 
10 


10 
10 


S25(X) observed cu- 
mulative dts' 
tnbution 


0 

20 


0 
20 


20 


20 


3 

20 


7 

20 


10 
20 


i2 
20 


16 
20 


20 
20 


t(X) - S:.(X) = 


2 

20 


A 

20 


5 
20 


7 
20 


7 

20 


5 

20 


A 

20 


4 

20 


2 
20 


0 



highest H,,(X) (X) 



Equation 
L 

2. 

vi. 



K W - % (^) = D Highest D = 7/20 ^ 3.5/10 = .35 
Consult Table £ 01 probabilrtyx N 20, Significant D ^ .33f) 
Rejection region: To reject the null hypothesis D .56. 
Decisfon; John's data shows -35 v^^hich h less than 356. I le 
can reject the null hypothesis and finds support for his hy- 
pothesis that his students like the point system. 



Kni«k«l-W«Uis One-Way Analysis of Variance 
by Ranks 



This test IS used to determine i^hether two or vnun. rndtptj Jtni 
samples comes from the same population or whether thry can be 
said to besigniHcantly different from one anotht;r. The test assumes 
that the variable under stutly be at least urdtT\a\ k*vel of measitie- 
ment and have an underlying continuous distribution. This means 
that the variable may have any value in a ccrtam interval not 
restrictt;d to isolated values. The Kruskal-WaMis tesi has a relative 
power of 95.5% compared to the parametric H test. 

EKample j- 

Joan Rollinson taught twenty-seven third graders, who had var- 
ious levels of abilities. She is trying to fmd the most efficieiu rnoje 
of giving Instructions for the children in her cl^ss. 
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Kypolhesis: There will bo significant difference' in perform^ 
finte on the ivi>\ amon^^ the three ^ruups reLeum>; in- 
siructtons. written in.structKins ^ind both. 
Null Hypothesis. The pcTformdnte of the difleicnt ^fuupt> 
will be no different. 

Statistfcal Test; Th^l^Tuskal Wallisle^t tsthi^rsenbeiau^ejijan 

IS lookmg Ibf stat(stJtal sigmtitantt amiing two or mi^ie ifam- 

ples and the data i5 ordmal level tn measurement 

Significance Levfll; Lei a (alplia) - 05. N = 30 numbi.'r of 

students. 

Computation 

Qata 



Oral 


Rank 


Written 


Rank 


tioth 


Rank 


17 


7 5 


10 


15 


20 


1.5 


13 


55 


14 


12 


19 


35 


15 


1.1 


13 


13 


20 


1.5 


17 


7.5 


16 


9.5 


18 


5.5 


16 


9.5 


11 


14__ 


J9_ 


35 


K = 


41.0 




63 5 


R, ^ 


13.5 



Equation 



H = 3(N + n 



I - 



IT 



- N 



N = numt)er of scores 

R, = sum of the ranks of <i column sijuared 

N = numlH*r of scoa^s m a column 

T - t^ - t(whentisthenumberoftied scoresin dtied grt>up of 
scores 
1 - T 

Note, r; rr is only used to Lorrect for ties If there tire n^r ties 



- N 



1 M 



12 



1505^1) 5 



delete this part from the e<]uation 
JM ^ , <i:^2)' - 3(15 + 1) 



6+6+6^6+6 



(15)'- 
H - .12 1681 
240 5 



15 

3969 172.25 

^ 4 

5 ^ -5 



3360 , 

II - 1336.2 + 793.8 + 34.45 
20 



- 48 



AH 



112 
H = 10.12 



1 



.049 = 5 78 



Consult Tiible sample si/e = 5555x p = ■ ^ 

Rejection region: Ms^ Rolhnson Can reject the null hypothesis 
if the H derived from her data is greater than the M on the 
chart (5.78) 

Dedsion: Since her H = 10.12 which is larger than 5.78 s^he 
may reject the null hypothesis. Ms. Rolhnson does find sup- 
pi^rt for her hypothesis that there is significant diffeience m 
performance with different type of instruction She would 
thcretorex um: tx^th oral and writttn mstrustiiHis to facthtatt 
her pupils performance 



Manii*Whitney U Teat 



This l^t should be t<J determinL' whether two indcptinUcnt 
groups have been drawn irutti different popiilacion^^ dnd Mh<*tht;r 
they are significantly different. The daU rt\ubl be at least ifrJinal 
level of measuTvmenL Mann-Whtkney U is itneof Iht ijii^sl pow 
urful nonparanuiinc Wsls. Wiien CifmpareJ iKt (he parametru T 
(est. It had 95,5% of ils powiT tv rejwt the nu[l hypothe:>L> Mann 
Whitney U is a iisefd allernatLv<2 to the T-tCst, then, v^Uvn the 
assumptions of a parametnc lest cannot be made 

H}(ample 

^Marlene Piscttelli noticed that her students uith difmma/ict prub 
lems in the remedial reading slmK svemed to have more problems 
with reading compi^ehension lhan the other students. She decided 
lo find out if thttre was a ^ignifaant djfft^renvt^ bt(»\Lvn the h^o 
groups. Her study follows: 

1. Hypothesis: There will be a significant diffeivnce in achieve* 
ment between the students who fiave laterM dominance piob^ 
lems and those who do not. 

Null Hypothesis; The two groups were drawn from the same 
population; (here will be no sigmficanl difference in perform- 
% a nee. 

iL Statistical Test; The Mann-Whitney U test is chosen because 
the data is nt the ordinal level of measurement and Marlene 
is looking for significant difference betu'een two independent 
groups. 

iil Significance Level; Lei a (alpha) = .05, N = 2, students wMh 
dominance problems. N** ^ 6 students with nu dominance 
problems 

IV Computation 
Dala 



N 1 


41 


45 










N 2 


78 


75 


82 


90 


51 


68 



90 


83 


78 


75 


^68 




45 


41 


N, 


N, 


N, 




N. ! N, 


N 





U = No. of N's prea'dmg N/s, 
U = 0 

2. Table | = 6, U = 0 N^ ^ 2, SigmfKant at .036. 

V. Kejection Region: The U has to be so small that the^e wi. Jd 
only be .05 chance or less thai it could ha^e occurred by 
chance. In other words the significant level must be ,05 or 
less. ^ 

vh Decisions Since the significance level ior Ms Piscette It's data 
is equal to .036 which is le^s thckn 05, stje fi^ds sup)x>rt for 
her hypothesis that students with hterality problems aljio 
have difficulty inVeadihg. She may reject the null hypothesis 



RandoinlMtion Test for Two Match«d 
Samples 



Thi5 test is a useful and powerful nonparametnc technique for 
testing the significant difference between the means of iwu 
matched samples when thf two samples are small. It require* dt 
least interval measuremi'nt uf the variable being studied. There i^ 
no assumption of normal distnbuttons or homogeneity ot vanante 
fwhich means the two samples don't have to scores ei^utdiiitant 
from one another) like the comparable T test assumes. The Ran- 
domization test efticienlly uses all informatton and therefure its 



power lo reject (he false null hypolhi'sis ts essentiall' t00%. An 
example is shown ^>el^w. However, if the samples are large, the 
Wilcoxon test may be more efficienhto use 

Example \ 

, Mike Brown i.i>ni.erm;d Iharsum^ i>f hb ;>tudLnts arur/I doing 
as veil lin his tests as Ihty are capable iff doing Me feoK thai th^) 
get tO'i anxious and feel the) will flunk the test To vanf> thi^ 
observation^ he admmistered the Fear of Failure test and foond a 
high n<:grtti\t' »vri\*lafion btliwtn tht sn»res i>n that test and hu 
own reading tests. Mike thi-refore decided to p\K the studunt^ an 
option to retake the test as often as the> uant He uants lo find 
out if the students will do better vn the tests if they feel le*.s pr% » 
sure. Mis il^dy is shown bebw. 

I. Hypothesis, Thtre v^di Ix a ^jgn^f^ant mi^reasc ^n riadme 
scores when the students are givtn an uptmn to retake, the 
tests. 

Null Hypothesis; There ^ill benodjfferemt jnthet\\osujre* 
iL Statistical Test: The Rondon^i^tion Test lor Matched Pairs is 
chosen because the interval levL^ uf measurement is used, the 
samples aa* matched and Mike is looking for significant dif- 
ference 

111. Significance Leveh Let a (alpha) - Q5, N = number of pairs 
s =8. 

^iv. Computation 
Data 





Differences between opiioivno 


Names 


option 


Tina 


+ 19 


Ed 


+ 27 


Marty 


-1 


Larry 


+ 6 


Pam * 


^ +7 


Michelle 




Amy 


-4 


TOfVL 


^ +3 



Six most extreme positive outcome (a 
(alpha) = ,05) 



Outcomes ^ Ed, 



1 


4^19 


+ 27 


+ 1 


+ 6 


+ 7 


+ 13 


-1-4 


+ 3 


SO 


2 


19 


-+-27 


-1 


-+-6 


+ 7 


+ 13 


+ 4 


f 3 


78 




^ t9 


^27 




-+-6 


-f? 


+ 13 


+ 4 


-3 


74 


4 


^19 


^27 




+ 6 


+ 7 


+ U 


-4 


+ 3 


72 


5 


^19 


^27 


-1 


-+-6 


+ 7 


^13 


+ 4 


-3 


72 


6 


^19 


-f 17 


-1 


+ 6 


+ 7 


+ 13 


-4 


+ 3 


70 



V. Rejection region; Mike sdata falls into one of three Six extreme 
outcomes than hts scores represent a significant difference of 
a (alpha) = .047 , 

vL Decision: Since Mike's set of data did match one of these 
extreme outcomes^ he achii'ved significant results at .05 prob' 
ability (alpha). He can reject the null hypothesis and finds 
support for his hypothesis that giving a retake option on his 
tests Will improve his students' scores. 



Sign Test 



The Sign test uses plus and minu^ rather than ijuantitive 
measiiK's (ts data U ts parliioliirly useful Mith data which can 
not be ifuanttCatively miaSured but in uhich d vi possible to rank 
uith respect tu eath uther the twomembt^r^iof each pair The only 
assumpttt.>n is that the variable mcasiired has a ^' riinuous distn 
bulion, thai is^ thi^ data uin take iinv value This ItsI is lob*' 

63 



usecf wh^n the subjects arv Hraun from m«^tcluMi sttmpk's TKk 
c^n be ^ccomplislied eitl>er using tlie siib|iib,(^.s tlinr u^n 
controls (tesb'retest) vr by usji»j'^ Hifferent uhuli jrt 

matctied in respect to tlie elev^nt \dn«bk^ Tlitf iH>ui*r tjf thi- Sign 
test to refsct tlie f^lse null tiypottiesis i. aKjut 95'7 wlu-n N t>, 
and as tlie sample mcreases its i^\entual jHiuit ls 63'^ A i-*m.pk 
problem is shown bclow 

Example 

Joe Risk's siwh graders having been labelk'd "truubk^makers ' 
early in their grade school Careers were constantly disrupting hi*i 
reading dass. AsMr Risk lett these disruptions were not conduciw 
to learn j either for the troublemakers or the oth«*r class members, 
he decided lo try a token economy in the class to decreasi* thi* 
acting Qut behavior He put the class on a point svstem. m which 
thedassas a whole could earn points for partiapating in class and 
points >vere taken away fordisruptivebehavior The fH>ints earned 
went toward :he privilege of getting out of class early on Friday 
Mr Risk wants to find oui^ if this point system is an effective wav 
of controlling behavior. A synopsis of his studv follows 

I Hypothesis; The children will receive a higher bt'havioral rat- 
ing after the use of the point system, where I = disruptive 
and 5 = well behaved 

Null Hypotehsks: There will be no difference before 4jnd a* r 
the use of the point system 

II. ^tdtlottcal Test: The sign test was chost^n beC'iusr ^he meas- 
urement is ordinal and the samples matched 

II, Significance Level: L^U (alpha) .05, N =^ I7students (this 
may be reduced if there are ties) 

iv. Computation 
Data 



Name 


Pre* rating 


Post*rating 


Din^tK-n of 
DiffiTence 


Sign 


Marth 


5 


5 


D-D 


0 


Frank 


2 


4 


2 < A 




Eddie 


1 


3 


1 < 3 




Mitch 


3 


4 


3 < 4 




Rita 


4 


4 


4 4 


0 


Suzanne 


A 


5 


4 < 5 


+ 


Letfi 


4 


5 


4 < 5 


* 


Tom 


2 


3 


2 < 3 




Rick 


4 


2 


4 > 2 




Mike 


4 


3 


4 > 3 




James 


3 


-1 


3<4 


+ 


Chns 


3 


5 


T < 5 


+ 


Bob 


2 


4 


2 < 4 


+ 


Barb 


3 


4 


3 < 4 




Allan 


1 


' 3 


1 <^ 3 ^ 




Joe 


2 


3 


1< 3 


+ 


Ellen 


4 


5 


4 < 5 





N 



1 

V. 

vj* 



15 X =^ numlwr of fewer signs = 2 

Consult Table DN 15, X = 2, p = 004 

Rejection region: Joo mav reject tlu* null hypothesi5 if p - 

.05. 

Decision: SirKe p = 0O4 tvhich is less than 05, Joe can reject 
the null hypothesis and finds support for his hypothesis that 
the point system reduces disruptive behavior Mo wiH con* 
tinue to use thi point system 



The Spearmftn Rank CorreUHoR Coefficient! 
Rank 



n'vrr 



or* tistsomi>times called rho is one of thi bvsi kno^%n 
tci: It was developed to determine thi- <imuimi ot 



relatjonjihip bet^it^n viiriabks vvhii^h naisl b<^ nivasurMv at t\w 
ordinal level Huv^evcr, nu ri'latiun^hips bi iMiibhshed usiiig 
thjs test^ t»nly degree of reldtionship Thi^ mori' thi ranks wilhin 
tiAO sots of H'jri's agn^i*j thi' ** ghiT tht pusilm a>rriUln'ni ilu^ 
more thi^v Jnergi^ Iriim one Hdtiuthi'C, Ihi highir Jho m^j^jtivi' tur- 
relation If there if)^ nu diMern^^bk pattern ti.> tlu uirtcibli s vaniini^i' 
in relation to one ^no^her than thert.* is saui to be tow corr^ t^tion 
or httle relation?*, jp betwei^n tht^ scoros Hit* Sp*.Mrmjn Ranx Cor- 
relation test hiM> 91^ o)[ the power to re|t^'i ihi* null hvpothi'sis of 
the Pearson r, a aimp^ir^bk- p^rametrK ti-sl 

Etiample \ 

John Stock wishes to |ind out it two tests he givi»s his class at 
the beginning and end ot evi^y ve^r mi^^suri* ilu* Si) me aptitudes 
The two tests are the VVotxistock Ri^ading tist and tht* reading 
section ot the Metropohtan Primary IL Hi^ will determim^ this by 
finding the strength of relationship U^iwwn the scort^s hus titth 
graders obtained on the two tt-sts tsrt* p 47> A synopsis ol this 
portion of his study follows 

I Hypothesi : There will be a signif^antK strong ptKsihvr re- 
lationship between the scones obtained on the^Woodstock|est 
and the Metropolitan Primary II I 
Null Hypothesise There will be either no ri'latiunship or neg- 
ative relationship between the scores obtained 

II Statistical testi The Spearman Rank test will be used b<?cauj;e 
Mr. Stock wishes to find the strength of relationj;hip 'ind ttie 
data IS ordinal level of measurement 

III Significance Level: Let a (alpha^ - 05^ N = 15 (5tudenisor 
sets of scores) 

IV. Computation 





yViHHl 
U'St 




Wvuu 

pull 

I'rl 
Rurv 
II 




ldilJvivmv> 


jean 




]4 




0 


0 


Tony 




4 


4 


0 


0 


Rachel 




13 


11 


2 


4 


Tim 




5 




2 


4 


Ann 




10 


12 


- 2 


4 


Lela 




3 


2 


1 


1 


Tammy 




1 


I 


0 


0 


Rick 




7 


9 


2 


4 


Ruth 




S 


6 


2 


4 


Mary 




2 




-J 


<) 


Phillip 




12 


10 


I 


1 


Clark 




12 


10 


2 


4 


Kevin 




6 


7 


- 1 


1 


Mike 




15 


15 


0 


G 


Pam 








-2 


4 











di^ ^ 40 



Equation 
1 



rs - 1 



t 



or 

- N 
6(40) 

(15)^ - (15) 
240 

It 



I 



240 
33W) 
rs - 1 07 

rs - 93 

ConsuhTabieT N -- nsjgniJi<:aiiu''k'U*l OH. iritiuil \alut' 
of rs - 425 

Rejection region. It r svur^' is larjitr than tht- mlK*il lalui^ 
ot rs ksti'd jn P, thtn y^v taji rt>i*d thi- nu)l hvputht^sis 



6^ 



Decision; nee Mr Stock's vmIuc vvjs brg^-^r thtin the Cril- 
icjI value 425 he can rvject thi* null hvpothesis *ind hnd -up 
port iof his hypDthi'SES th^t thm* is j irlatHmship b<*txi,(?<?n 
t^e Metropohtan Prim-iry and Woodstock Ri^ading lesK 



Wilcoxon Matched^Pairs Sls«i«d-Raiik9 Test 



This ti^st IS \x^*d io delcrmine if there is sigmfiCatll ditterc^nce m 
direction ^nd magnitudt* betwi'cn pairs of scores For oample li 
a (^acher is interested in dscortaimng wht'thef more achievt^ment 
scores increastti Or decreased md whether llu^rt' was a biggw dif- 
fetena* m the 5cori*>$ which increased or those which decreased, 
then (s)bo would use this me'' oU 

Teacher wifl us*^^ Statistical Models 4, 5, or 6 in confunction xvith 
this test The data must be ordinal level, i c the teacher must W 
able to make a judgment of greater than between jny pair's txvo 
performances 

\i all L ^^^ecntena are met then use thi*; mHhod rather than the 
Sign lest, as the Wilcoxon is m^tw powertui than the Sign, that is, 
it uses more infomtalion than the Sign When a>mpared lo the t' 
Test <a parametric te*it), U is found to be ab(>ut 95*^ as effiaent 
This IS powerful for a nonpar imetric test 

Example 

Kaihleen Uergman is trying to determine tf the PLATO prt>- 
grammed mstructio/i technique improves children s learning 

I Nil'' **ypolhesis; There will be noincreas*'^ in the achievement 
s' ' i obtained or^ the pre and pfwt tei»t given h> lhe<^|>iJdren 

lie and after treatment 
Hypoihesis^ There will be a significant increase in the achieve- 
ment scores oblamtd on the prelesls and post tests 

II Stalistkal T«sh The Wilcoxon Matched-Pairs Signed>Rank 
Test IS chosen because the study employs two relaied sample^* 
(two s<>ts of jcores for each child) ^nd li yields di/ferenl scores 
whKh may be ranked inorder of absolute magnitude {absolute' 
difference in the two scores) 

III Significance LeveJ; L a (alpha) ~ 025 N = Number of 
pairs of scores or number of duldren minus any ptiirs of scores 
whose difference wc ^ zero 





12 - 2 = 






=^ N 


Post 




Pretest 


test 


IV Data 


score 


scort 


John 


63 


82 


Su^i 


42 


69 


Fred 


55 


5S 


Larry 


74 


73 


Tim 


37 


13 


Mary 


5! 


58 


Rob 


43 


56 


lerry 


80 


76 


Joe 


W 


60 


Mac 


79 


82 


Lois 


90 


85 


Ed 


40 


70 




E<luation — none for N 25 
(For N 25 the equation rs 



NMN+ 0<2Ni- I) 
24 

N in this study - 10 ^ 25 Therefore go directly to Table C 
find 025 under one lailed test Find 10 under N 

VI ^ Rejection recionr Since the direction of the difference is prt^- 
dieted 0 e the scores will increase), a one-tailed test is ap- 
propnate. The region of rejection consnts of all values of T 
so small tnat the prottabihty associated xvith their occurrence 
under the Null Hypothesis is less than or equ^il to a (alpha) 
= 025 for one-tailed test. 

yii Vecision^ Only three children in the study regressed while 
using PLATO Looking at Table C with N = 10 and T = 8, 
so a T = 8 allows us to re|ect the Null Hypothesis at a (alpha) 
- 025 for a one-tailed test We find support for Kathleen's 
hypothesis the children do *ihow significant increase in the 
achievement scores obtained on the pretest and post test 
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Appendix 3: Tables 



List of Tables* 

JMc A TaWc of Pfohabdtht*s Assooated tvith Vafiios .i^ tmlrvrTK* .is 
Observed Values of z in the Normal Distnbuhon 

TabJe B Table of Cntical Values of t 

TaWe C TaWe of Cntical Values of Chi Square 

Tabje D Table of Probabilities Associatexi with Values as Small as 
Obseive<i Values of x in ihe Binomw! Test 

Table E Tabfc of Critical Values of D in the KolinogoJOv'-Sminujv' 
One-Sample Test 

Table F Table of Cntical Values of r m the Runs Tf?st 

Table G Tabfc of Critical values of T in the Wdcoxon Matched- P.iirs 
Stgned-Ranks Test 

TaWe I TabJe of Critical Values of D (or C) in the Fisher Te^t 

Table J Table of Pmbabilitics Associated with Vahies as Small as 
Observed Values of U in the Mann-Whitney Test 

Table K Table of Cntioil Values of U in Ihe Manri-Whilney Tvst 

Tabit' L Table of Critical Values of K in the Kolomogoru(\''Smimo\^ 
TwO'Sample Test 

Table M Tahiti of Critical Values of 0 in the Kolmogorov-Sn>imm' 
Two^Sample Test 

Tabfc N TaWe of Probabilities Assodati-d with Valuta as Lirge <is 
Observed Values of in the Pnt^man TwtvWay Analvsis 
of Variance by Ranks 

Tabic O Table of Probabilities Associated with Values as Lirge .is 
"^b&^-ved Values of H in the Kniskal-Wallis Ont^ Way Aaih 
ysis ot V'anance by Ranks 

Table P lablj oi Cntical Values of rs. the Spoamdan R,^nk Com- 
latmn Coefficient 

Table Ci Table of Probabilities Assooated wiih Viilues *>s Li\nw as 
Observed Values of S in the Kendall Rank CorreLiiK>n Ctx-^h 
fident 
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Table E. Table of Critical Values of D in the Kolmogorov^ 
Smimov One-Sample Test* 
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Table M. Table of Critical Values of D m xUa Kolmogomv- 
Smimov Two-sample Test 



Table N, Table of Probabilities Associated with Values ^s 
Large as Observed Values of Xr m the Friedman Two*way 
Analysis of Variance by Ranks* 
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Table O. T^bk of ProbAbilities Associated with VaJues as 
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Analysis of Variance by Ranks* 



Table TabJe of Probabilities As&ocialed with VaJues as 
Laige as Observed Values of if in the Kruskal-WaJJis One-way 
Analysis of Variance by Ranks* kontinuea) 



• 






it 








H 






i| 








2 1 


1 


2 7000 




■J 1 


■> 


6 4444 


















<> WXi 






2 2 


I 




2ai 






^ 4444 


















5 4(11) 






3 I 


3 


4 


0(j7 






4 S^ll 












200 






4 -14^4 


Jit: 




3 1 


1 


J2O0O 


3t)0 


■J 1 


3 


6 7-J5'i 


. 010 




^ 2 


I 


■» 2Jn57 








feTlwl 


on 








3 ssri 


133 






5?f«W 


















^ 7273 






> 2 






02^ 






4 7W1 










4 7113 


C^S 






4 7(Mi 


LOL 








4SO0O 


067 
















■» -JWT 


105 


4 4 


I 


fe6M>7 




















(l2^ 




r 


i 




>J3 ' 






■1 VW>7 


tun 








■» "1711 


lOO 






4 


054 










12^ 






4 1667 


0K2 




% 


2 


^; oo 


Oil 






4 0667 


Ki: 








M>LI 


0X1 
















^ im 


06L 


4 4 




7 0V>1 










4 "1556 


100 






'>J!*7;7 


on 








4 2500 


121 






^ 454'i 


0)h 
















■^23^1 * 


(152 




y 




7 21100 


0(4 






4 i'^^ 












OlS 






4 44'ifH 


103 










02* 








{>/0 








^ 6000 


050 


4 ^ 














5 0667 


0S6 






r l4Ti» 










4 6222 


100 






71V4 


















^ ")^;t5 


















*^57V? 






\ 1 


1 


>S7n 


200 






4 M'W 


ow 
















4 4773 






4 2 


1 


4 82n 


OS/" 
















4 SOOO 


07*v 


^ -1 


4 












A om 


M4 






7 "l^K^ 


















■^64^1 






1 2 


2 


60UOO 


014 
























4 6SV) 


on 










o:c 






4 SfUll 












too 








nv] 








4 lo<>7 




1 




^H^;^l 




















1)4 


















143 




1 ^ 


1 




rci 




1 4 


^ 2Srt* 


oV» 


















t4** 








^ jOO 


057 






4 4500 


U7i 








■» 0556 








■1 2)111 










3*tfW^ 








4 U^l> 



































fli fl^ j?t 






^22 


6^33^ 


(1)K 






O^T 




6 


Ol3 
















4 ^^IJ 


fot 




5 WIlW « 


056 




i 






■1 3733 








01 




4 2<?13 


\22 




" 744(1 


Ol 1 










^ 6^7 L 




s 1 1 


64WX) 






5 M7^ 






4%(1* 






4 6Ih; 


1^)0 




4 S711 


0'^2 




4 


11^ 




4 017^ 












3 moo 








an 










6M3M 


on 


1 : 


6M>^J 






^ (27* 






6fl2lH 


01 0 




4 '^1*^1 






5 250^ 


(M^ 




4 li*4i 


<i86 




^ 10^5 


052 




^ 0364 


1U5 




4 t,W> 


Ot>l 










4 


l!ll 


s ^ ; 


7 3385 


0M» 










7 2692 


OLO 


' > 3\ 




f>09 




5 'iJiiF, 


017 




Oil 




5 2462 


0^1 




5 64i;'i 


04 1> 




4 62» 


097 




5152 


^51 




4 5077 






4 533? 


0*7 


'j 'I ^ 


? S7B^ 


m 




4 4121 






7^29 


010 






r)Ofi 




^ 7055 


(Ho 


^ 4 1 




'I 6264 


dsi 




6tW(ll 


oil 




■1 S4Sl 


IQU 




4^*15 
4 iiftOO 


0^ 




4 'i363 


102 




1 <>873 




^ 5 4 


7*229 


om 




3%0ft 






7ftl4 


010 










^ 6657 


(MV 


4 2 


7 204^^ 


00^ 




S M29 






7 JJ82 


om 




4 


0« 




■^2727 






4 ^2U0 


toi 




S2*j«2 












.4 54(N 




s 




00^ 




4 SU2 








010 














^ 4 


7444ft 


)10 




^6600 


O^^l 




7 3919 


oil 




■1 5ft0(< 


100 




5 6564 


1^9 




4 <^100 


La2 



• Adjpl* J Jiu) 4bnd((<'<l Jfom KfusVil W H jnd ^^jHi A 19*.. Lsc «1 t»nJ^s 
r.M»ion vi thf jutho'^ and the putlKhci torr^Oonx l<> Ihis rjbk ^iivm b\ iht 




Tabic P. Tabk of Critical Values or r,, the Spearman Rank 
Correlation Co«fHden£* 



Table R. Tab!e of Critical Valuer of s in the Ktndall 
Coefficient of Concordance* 





SiKfti*i*Jt« If sol 












4 






S 




] 1XK» 


t> 




^1 








ft 


Ml 


Wt' 




60ft 




LO 


'htA 




12 






L4 


4^ 




}b 


42S 




1!^ 






20 






22 


WO 




24 




4»S 


2t 




4*S 


2» 


117 


44*( 


>^ 




412 



'Adjptpd (T(H(t Olds. E C L4Vf Oii-mbuttonf uimMtt f^tUAn^h Mnk diK'^remes 
Ann Math SUii^t 20 Il'-IL^ ^jttithf kjodpfrmi^Monuf tht jutk^rjnd thf publj>her 



Table Q. Table of Pi^babilih : Associated with Values as 
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Glossary 



ABILITY TESTS 

Tcs\^ ihiit purport tu mtv.>itfp an indnnitial ^ iiM^r .lU MiiJitv »n 
duing givt^n thmgb Q/tt'n ^ dishr»Jiufi is dttt^mj ted bi'hstvn thdi 
facility which rcstilb Jrum ht^rvditv ^jnd that »\h*th ri^sults ironi 
learning In such tasi*b, tjh/jlw tt*bls jr^ **'-uaJI\ dppiit>d ihv nj 
hve " ^pecl and aihtcivrrwnt testb U> th. .jrnovl (isi>t^t 
EX— IQ tursts. Dominance Uist 

ACHIEVEMENT TESTS 

T(.*sts that purport to measurt^ an individual pertorn^jn^ t* or 
petenc<^ relative to a givtm bubje^t. usu^illv a *.tib|t'Ct taught in tht* 
schools Achievement tests are concerned with tearneil outa>mes 
(generally knowledge and/or understandin^J tathi'r than 'native ' 
capaaty or abhty to karn the subject 
EX— Metropolitan Achievement Te^^ts. MacGinitii' 

AGE EQUIVALENTS 

A method of expressing sc^ires on standardized Usts Tln^ raw m ort- 
typical of pupils of differer.t age^ l^ det**rn(^mfd and then 
pupil's raw score may be converted to the a^e to which it pt^n^iins 
Usually given m years and months 
EX — Mental age - 12 6y reading age ^ 10 4 

APPLIED RESEARCH 

Aims to solve an immediate practical problem It is research pt^r- 
formed in relation to actual problems and tinder condititms in 
which they are found in practice 

EX — \i> *)ral prnentation or wntien pn^vnlututn more etteitiie m it» 
proving iiiudeni:^ pcrfortttitn^f on h^t^*^ rtaiUn^ lomprthcty^tiiti im 
proved by using th^ ttidivtdiuihzeJ appn^nh as opptTseii ti> thr 
tritddio tat rtttdit:^ apprvacff^ 

BAR GRA 'H 

Any graphic pre^entati<»n that uses bars of various length t«> svin- 
bdizc diffc^renceb inft^^^^^V' ^tze* amount, etc 



n 



n 



Bill Jdv UnH 



BASIC RESEARCH 

Has as itsaim obtaining data that can bo used to formohto,4'xpand, 
orevalxxale theory^ ll,s essential aim is to expand the 'ronliers ot 
knowledge without regard to practical applrattor. thojgh th*- re 
Suits may be used to solve practical problems 
EX— Js there a relationship b*;twecn disruptive behavior and read 
ing achievement? Is there a relationship bctwtH?ri oral language 
skills and written language* skills' 



82 



BI MODAL 

A distribution ^'t mt asuri s. p^irtik Usl sior^s, isith tw^t h^i 

ill Ltntrai t^ndeniV rather tiian i^nc A sgp^r^sial mJiiJia^n uf 
himi^essiahtv is the p'tsinit nt tuu nii'Jts siparatrd b\ spurts ur 
\^\tTi. intejr\als whose lreijuenc\ u appreciabU li ss than that nf I hi 
modes Bimitdahtv m a distnbutK>n un bi^ suggestivt- kA several 
atmbutos ot the ^roup or nt the test or u/ier fr-t*asunnf^ pymeduje 
^ tn use It often mdicatec that the gt's^up whii^h is bim.idal involves 
two subgroups having inxporttini meai^ di(feri^nce,s as to ti>^e men 
taht\\ reading abilitv. nationalitv, ett. 
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CENTRAL TENDENCY 

In a distrbubon of scores or other m^'asurtn^, the fx>int \n inter\ai at 
v\hKh a pluralitv i^r mai^tfit\ of s^oa^ tt nd^ to iluster t^ilvss tJiea is 
suji a Llu>tenngH the distnbutji>n has no cvntral tendtlia 
AH d!S*nbutKins ha\t a tvntral trn lena 




)0 ZO 3U «0 50 
Scores on »ocabul^T\ ^p^t 



rtits disiributiti (t(i(s fu)1 ha40 a ct'itir^l trni)m\ 
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CHECK LISTS 

A device us<?d in obstwation t(> JiirM flticitior* lo factors to be 
observtKi 3nd sometimes lo p»LUidtf i»pace for recordtng rai>rgs or 
commcnLs relative to th^m 

1 Can read accurately a ra-e of 15 words/Minute 

2 Can di5cnmina*e ti:wct*n two similarly !>pelW u\*rds 
J. Can follow Tally giv(*n diivction 

C.A, (CHRONOLOG^ICAL AGE) 

A child's age expressed in years anc) [m>nt»\s U%ed in reckoning; 

the intelligence quotient and any other mdex mvolvm^', a u>mpar- 

tson bC'tween skill or knowiedge artd agt*s 

EX-rBilly IS five years and three months old His C A ^ ^ 1 

CLASSIFICATION 

One ot four twsic forms of Measurement <tvpi^^ of measurement 
symbols). Involves the e^tabUshn^^l of catt^ jnes (classjficalionl 
th^ designation of symbols for 'he caiegones, and then the as- 
signment of the symbols to phenoiiiena accordmg to the category' 
to whit(i they belong. This is sometii.ies referred to as thi Nominal 
Level <4 measurement 

EX — Blood typing, draft classifications A B, C. D H as course 
marks 

COEFFICIENT OF CORRELATION <r) 

A nieasure of the degree with which the venation of iine variable 

IS assoeiated with vanatmn of another variable 

EX—, 

Intelligence Grades Conclusion 



{oe 
Sue 
Fred 
Linda 



(2) 
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3 5gpa 
2 5gpa 
2 0gpa 

4 0gpa 



If you have high tn- 
telli^^ence ytsu'll 
have high grades 



CONCEPT \ 

An abstraction from observe^ invents, it is a word that rt-presi^nts 
the imilanties or common a&pijcts of ob|ecti or events that are 
olljemise quite different from orw another The'purpo^e of a con- 
cept IS (osimphfy thmking by including a number o/evtiiis undii 
one general heading. 

EX-^ Words socfi as chair, dog, tr*>e, li<|uor and thousands «f others 
in our language represent common aspects of otherwise diverse 
things 

CONSTRUCTS 

Highef level abstractions that cannot bt*eiisiK illustriiied bv point 
ing lo specifi<iob|ects c-' vvcnts 

EX— ProbJem-solving ability, motivation; |ustice or hitelligence 
CORRELATION 

The statistical techni:jue used for mv ring the degree ol rela* 
Itonship between two variables is calltMTi com'latt.itt Correlation 
shows us the extent lo winch values m on(> variable ^ire linked or 
related to values ^ another vanabJe An important use of su^h 
measurement is m prediction WJien correlational ana lysis indicates 
some degree of relationship between two vanablesw wc can use thv 
information about one of Ihem to make predi<tions about the other 
EX— Having found th^t imelligi^nce and achievement are torre- 
lalcd, one can make predictions about Ihe future aihieu*n^ent *jt 
school children from the results of a lesl of mlelligenci? given at 
the beginning of the school year The accu racy of such pre^liction 
IS a function of the degree of retationship^ that is, the extent of the 
correlalt: Tlie higher the correlatiOEV the more accuratt* the pre - 
dictions. 

CRITERION 

Anything with which a measuring procedup* is compared in de 
termming its validity Speeifually ^ meas^'ritig i.iTtKt*duro tor .i 



given phenomenon for which exemplary vahdity is claimed or as- 
sumed aad with wnich other similar procedures are asked to have 
high positive correlations 

£X— To show your reading program's effectiveness, you decide all 
children must advance one yearin ability to read The improvement 
goal of one year is you. cntenon 

CUMULATIVE FREQUENCY 

A column m a conventional tabulation of scores or othet measures 
that shows the fre<^uency of scores up to and including any given 
interval 
EX-^ 



7% 



DERVIED SCORE 

A test score that has been converted to an index of rai^k, scale 
position, or classification, as distinct from a raw score, which is the 
number of correct responses Or the immediate numencal weight 
given the test Percentile rank, sia^^ard scores, mental age 
EX— A child gets 9 spelhng wOi*ds nght out of 10, he got a ^0% 
He did better than all the rest of the class Mis d^nved score is A 

DEPENDENT VARIABLES 

Vanabk-s that are a conset^uence of or dependent upon antecedent 
variables In lesearch studies, the dependent variable is the phe- 
non^enon that is Me ob|ect of study and investigation It is the one 
that must always be assessed 
EX — This IS sometimes called assigned variable 

DESCRIPTION 

. An informal type of measurement expression used to indicate the 
st^itus of phenomena in which ordinary language is used The 
information is not quantified This is also called the Nominal level 
of measurement. 

tX — Scale rank and classification symbols associated wtthappraisal 
of atizenship, study habits, social ad|ustmeni 

DESCRIPTIVE RESEARCH 

Descnbes and interprets uyttat is. It is concerned with conditions or 

relationships that exist, piactices that prevail, beliefs, points of 

View, or attitudes that are held, processes that are gpii>g on, effects 

that are beii>g felt. Or trends that are developing 

EX — There are several subcategories of descriptive research 

a Case studies 

b "Surveys 

c Developmental studies 
d Fo?)ow-up studies 
e Documentary analysis 
t Trend studies 
g Corre^ttlOna] studies 

DEVIATION 

Departure from a given londition In partitular, the numemal dif- 
ferena^ tK'tween a test score nr other measure of an iidividua) and 
given poirJ of referenccL usually the mean of a group of test scores 
or other iheaiiures 

EX — The class, average on a test H^, lill nwived a 3*^ This is a 
large deviation 

DISTRIBUTION 

A table or graph showing the scores or other measures found tor 
a group, vj arranged that the numbt^r who have a given score or 
who fall within given range of scores is apparent 
EX"" 
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FREQUENCY DISTRIBUTION 

A syi^tematic arrangement of individual measures from highest to 
lowest The use of this tochntqut mer«*ly invok't'S maktrg a list of 
the individual measures m a Column, with the hijjhost measure ai 
the top,' the next highest, second from tiK' top. continuing down 
until thf" lowesj^moasure is roCordcU at XYw txUtom of tht" column 
EiX- 
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EQUIVALENT FORM 

Either of two forms of a ineasunfi>^ instrument. particuJjrK ^.is'anJ 
ardized test which is paralld in content, Jifticult) , and norms, but 
different as to terms 
EX— Stanford 'Binet Forms L and M 

EVALUATION 

The process of assigning st mboK to phenomt-^na Thcs</ svmbols 
signify the worth of the phenomena rdalKe t ^ M^tmc scheme ol 
value 

EX — Grading student's paragraphs A, [J, C, D or V 
EXPERIMENTAL DESIGN 

The conceptual framewoik within winch the exp<*nment is con- 
ducted tt serves iwo functions ft provides opportunity fo-^ the 
compan^on^ required by the hypotheses of the expenment and tt 
enables the expenmenter thro^igh his statistical analysis of the data 
to make a meaningful nterpretation of the results of the study 
EX"- 

One group — ^ pretest — ^ tr<;alment post-te^t 
Exp. group*-*- pretest — ^ treatment 1 — ^ post^teU 
Control group treatment EI-* 

EXPERIMENTAL RESEARCH 

A saenhfic investigation in which an investigator manipulate"" a:tJ 
controts one or more mdependent vanables and observes the de- 
pendent vanable or vanables vanation concomitant to the ma- 
mpivtation of the independent variables Its major purpose k t<* 
determine "what may be " 

EX — Will subjects receiving individualized instructu^in achieve 
more than the students receiving traditional reading group inUrut- 
tion? 

EX POST FACTO RESEARCH 

SimJar to ex pen mental research ex<ept invWigdtor tdnn^jt JirettU 
manipulate independent vanables 

EX — Did my students achieve k?ss than a Lumpdrible^Jj?,?, btsaust 
they didn't have a regular teacher'' 

EXTERNAL CRITERION 

One needa an external cntenon that is Lnowi, to be a measure of 
tftt vanable mvolvedand ran be use .f to compare one's prediction^ 
Success in college, as reflected bv gmde point avt^age is a clearly 
defined external rnterion for validating those tests that are am 
structed for the selection of (College applir:*!its 
EX — Number of library books r* ud oi;'side of class assignments is 
an exiefnat cnicrtOn of reading **t.j<)yi,iofit 

FREQUENCY 

Refers in staKstir^ to the number of times a scoie is repealed nf 
the number jf scores appea nng in a given mterval 
EX— Joe and Sally got 85*Sf on the spelling test, Fred, Donna. Shirks 
and Bob got 80^^ Fre<]uerKy for 85 - 2 Frequency for 80 - 4 
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GRADE EQUIVALENT 

The grade for which the abihty is typKal 

bX — Kathy IS achieving; at the 4th gratle kteL 3rtl munth on the 
Metropolitan Achievement Jests E ler grade et^ujvaU^nt is 4 3 

HISTORICAL RESEARCH 

A procedure supplementary to observation A process by which 
the histonan seek?) to tvst the t^uthtuln^^s*^ i>t the reports ut ubwr- 
vation^ made by others Its mafor purpose is t() tell what was 
EX— Tracing the evaluation of the open classroom 

HYPOTHESIS 

A tentative postposition suggesteti as a solution to a problem or;iS 
an c^planatiorj of somi" phem>menon It presents in .simple' form 
a statement of the researcher s expectations relative to a relation^ 
ship between variables with the problem It is then tested tn a 
research study 

EX--Students who attend a remedial n^admg dime five hours a 
week will improve their seores on the Metropolitan Primary 
Achievement Tests significantly more than students who attend 
the chnic for only thrt'e hours a week 

INDEPENDENT VARIABLES 

Vanables that are antecedent to the dependent vanable are called 
independent vanables This is the factor that is measurably separate 
and distmct from the dependent variaHe but may relate to the 
dependent vanable Many factors that may function as independ- 
ent vanables are discnmmate aspects ot the environment, such as, 
s^al class, home envtronnoenti and classroom conditions Jn ad- 
dition, charactenstics of the individual himseh such as age. sex, 
intetligenre and motivation— may be independent vanables that 
can be related to the dependent variable 

£X — A child's height (dependent variable) would be dependent to 
a certain extent tipon his age {independent vanable) These terms 
are often used even in the absens^e of tmpinual or theoretical rea 
sons for considenng one to be tht' antecedent and the other to be 
the consequence The> are uslM to indicate the direction of pre 
diction— from individuals' positions on the independent vanable 
to their positions on the dependent variable This is sometimes 
calfedth^^ active vanable ItxamplesofDependent.ind independent 
vanables' 

1 Rcadmj^ ^<htewttinu iD V ) is effected by Sclf-<omqtt (I V ) 

2 V^<7rd htowkdj^e tl^ V j i* *^ependeni on Sviui} eiomtttJn ytatui^ 
0 V) 

3 Reading aihtet^rtU'tU tD V j is JepenJeni on Rcatliti^ ^nmtuoit 
U V) 

INFERENTIAL STATISTICS 

The process of gomg from the part to the whole A population 
tompn^es all the possible Case^ (persons, objects or events) that 
(constitute a known whole A sample is a pturtion uf a population 
EX— A representahve sample of lOOO six year old children obtain 
a mean raw score of 48 on the WlSC It is then inferred that the 
average' b year old will obtain a store of 48 of the WlSC 



INFERRED DIMENSION 

A property or quahly of a phi-nomenon not itself observobte but 

imput or inferred lo a piVnomonon. 

EX— A c\\M% knowledge is mcosur*?d by an I Q lest 

INTERCORRELATION 

A term appli^ lo oach of tho corrcbtions among a group of t^sts 
Usually displayed in lables showing the correlauon of vach test 
wilh each of the other iesi. They are Ihen used to show the extent 
of interr^tion^hips among c^itain group of tests 
EX — If a child scores h^gh on ih^ r^adii^ comprehension tesis m 
Cates-MacGinite test, then he wilt piobably 3core high'on ihe vo- 
cabulary test. 

INTERVAL SCALE 

Not only indicates the relative position of mdjviduals but also prt^- 
vtdes additional information about thes« positions because this 
type of sca^e uses predetermined equal intervils Such scales do 
not necessarily have a true zero point. Arbitrary zero pomts may 
be used, but such points are by no means absoluie. Consider in- 
telligence tests, for example. In th:^ lests theru' are zero pomts 
and it is conceivable ihat one> score could be zero, but zero sec res 
m these tests do not nean zero intelligence. For thi±> reason it j±> 
no? possible to compare an intelligence test score of 75 hith a Hurv 
of 150 and say Ihe latter s<:ore is t*vjce js high as the former 
EX — Number ot correct spelling ^t^rdb on an ex^m Sf.ore un the 
Stanfocd'Binet test. 

LEVEL OF SIGNIFICANCE 

A statistical term used to mdicate the amount of confidence m 
whetherornotthe difference be twe<*n t*vo means, twop^rcieniages 
or other comparable measures is statistically significant (not due 
to chance) Also referred to as significance of different and sta- 
ll stKaf difference- 

EX — If Suzie gpl a 93^ on a spelling cesi and Bill got a 90*^, is 
Suzie a significantly better speller, or is her better score simply due 
to chance^ 

MEASUREMENT 

The ^hssignment of a symbol oOcn a number, ^oas to charnftCterize 
the status of a phenomenon relative to some dimension, usually 
by indicating its scale positr^r. its rank, or iis classificaUon per ihis 
dimension. 

EX— Joe got 15 out of 70 spellmg words correct, or 75% of them 
correct This if a measurement of correct replies Ji the score lie 
received is the fourth highest test score, it is a measurement of [.is 
rank compared lo 'Others 

MEAN 

The most widely useci measiire of central tendency is the mean, 
which IS popularly known as the average or inthmeitc Qirraj^e ft 
is the sum of all the values m a distribution divided bv Ihtrnumber 
of casei*. In lenris of d fr *tila il is % - KX^IN 
wherCn X - the mean 
E ^ the sum of 

X each of ihe vjlues m thr distnbuiion 
N ^ nembe' of casvs 

EX — The average or m^^^aii Readif;^^ lest scof^r ' 

Jo « ii 

Sally ^ 3 

Mike - 6 

Tom * " 

MEDIAN 

The score or piant that dtvrdes ^ djsinljtitirn ot icwe^ .nm tv^'o 

equal groups wi*h half of the scores tjlh^iig ab*ve arJ 

U'-ed as a repres^ntatu e score or a n^easure tif cc*itTaJ .ef>;tency 



EX— Scores 4 12 18 21 16 18 I'i Ihe rc*nier score, il is Ihe 
median 

MODE 

The score or measure Ihat occurs most frequently in a distnbution 
EX— 3 studei\ts got 90 on iheir exam 

6 students got 85 on their exam 

1 student gpt 84 on his/her uxam 

8 students got 80 on their exam 




tw>6t - S 



go 84 85 90 Scoia 

NOMINAL SCALE 

The simplest type of scale and provides Lhc West le\el of quan 
titication of the objects to be measured A nominal scale simply 
s-^rts ob)e,t!>. or classes of objects, into mutually exclusive cate- 
gone£. Our data will only tell ub ho^ man> of the subjects belong 
to each group^^r how many students of a class are t>oys artd how 
many are girls. Dividing individuals into such calegones as smokers 
and iwnsmokers. Democrats. Republicans, and independents, el- 
ementary^ }unior high, and secondary, tail and short, and soon, 
are all examples of nominal scales. 

RX When we label Ihe expenmental units in a study as groups 

A. B and D, or when we dmde the students of a dass mioboys 
and girls, we are usmg a nomma) scale in each of these examples 

NORMAL CURVE 

A symmetncal distribution of" measures with Ihe same number of 
cases at specified distances belfjw the mean as at>ove the mean Its 
mean is the point below which exactly 50*^ of the cases are located. 
The median and the mode in such a distribution are identical values 
and coincide with the mean. In a normal cur\e. riiost of the cases 
concentrate near the mean 
EX— 




NORMS 

Statistics based upon a standardisation group or a group that is 
purported lo be representative of ^ much larger population These 
norm, are thus assumc^d to be representative of large groups 
EX — All fifth-giade children or all tw el vo'y earmolds, grade, age 
peicentile, and standard score norms are the mosi common for:ns 

OBSERVATION 

Themost widely used and usually most crudemethod of behavioral 
I measurements involves direct pera^p'ion of the dimensions of the 
;>henotrienon being measured VVilh appropriate attentionaL per^ 
ceptual. and recordir^ aids, observation can t>e a highly reliable 
procedure 

liX«-F7e<^uency count — Phillip got out of his seat without permis- 
MOff SIX times m the fifty rninule reading penod Irlerval count— 
M^K was noi attending to ;he lesson for 40^ of the thirty second 
intervals axx>rded 
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OPERATIONAL DEFINITION 

er^lion;* thai musi be ptTlomi(.'d in urdt^r U» mt^asurt* thv ^un^Lpt 
Thjs type of defmilioi^ \^ «:!»scnljd[ in rc^irar^h. simv d^ila must be 
^oll^cted in lermjiof oWrvable events. When \»ne detjnesa loniept 
or conslruct operationally, he chovses diiAnmirwble evenis as in- 
jK^lor^ of the abslr^il lunii^pl and deviM^s operations ti> obtain 
dald releeani to Iho concepts An opt.ralH»naJ dehnition thus refers 
loihe operations by whtchan investigator may mtMsitn' a a>ncept 
These are i>ssential to r^seaKh because they permit investi^tors 
to measure abstract concepts and construct<^ and permit a >cientLst 
to mtwe from the level of constructs and thi'orj* to tlie level of 
observation, upon whtch science is basi*d 
EX — Opera tionali/ed definition of achievement— scores obtained 
on the Stanford Diagnostic Achievement Test OptTationali/ed 
definition of reading enjoyment— number of bt>t>ks read outside 
oi class, not for assignments 

ORDINAL SCALE 

The use of the ordinal scale permils the sorting of objects or classes 
of objects on the basis of their i^tanding relative to I'ach other TIikN 
scale not only categ^>^^es but also ranks the objivrts on the baws 
of some cntenon A teacher who ranks his students on the basis 
of their tntelligenc^y achievement, class parttcipation, discipline, 
creativity, or anv other characteristic is making use of an ordinal 
scale. 

BX — Rank in class, percentile rank, percentiles 
POPULATION 

Used in an abstract sense in measurement and statistic!^ toindu<ite 
any given group of things, the total group in (juestion not |Ust pari 
of It 

EX— All the pupils in'ihe sixih grade in vour scbiK>l d: trict ts the 
population from which your sample (the children in vour Mxth 
grade class) ts taken 

PRACTICE EFFECT 

It IS known th^it a perfori^i^rice o* ,iny task afferts a repi^rformana- 
of that task, usually in the direction of improvement rntcticc efk\t 
IS the term for the significance of such ^'performance when the 
same test is administered to the same individual more than once 
EX — When pupils do better on a qui' the second time it is given 
in a week, is this because they know the material better or because- 
they have had practice with the question 

PRETEST 

Any measuring inst'irment (usually an achievement test^ admin 
istercil prior to a period of instruction, an experiment, or othtT 
circumstance of interest As a rule pretests are usee to establish 
the initial status of pupils so that the amount of their learning mav 
be judged from the results of a later retest 
EX — Students are given the Metropolitan E'nmary Achievement 
test tn September and again in Mav, The tests in September would 
be a pretest 

PROBABILITY 

As applie<l to behavioral measurement, the concept tEtat any meas- 
ure or statistic is somewhat subject to chance variation Hence it 
deviates from some theoretical[y "true" measure Such deviation 
IS commonly called error and its probable extent can be determined 
and stat^ mathematically See ia*ct of St^mftcaticc 
EX — There is .05 or 5'^ chaoce that thi^' v-nres wvrv ot^tained bv 
chance. 

PRODUCT ANALYSIS 

A basic procedure o*" educational evaluation in which tht' things 
that pupils produw m the cour^^c of instruction <jre appraist*d m 
appropriate w^ys and given scores or ratings 
HX — Compositions, outhnes 



PRODUCT MOMENT FORMULA 

A widely used formula tur tht^ ^orrt lal^^ n tti^^t nt i L\ bi the 
standard i»sufe for vanabk \ \i thi pairs v\ iinJ 7,\ s Jur * di.h 
indnidual are multiplied, thvn <idJt'J Xwi till mdiv^du.ils and d^ 
^.idetl b) thv number of ^.ast^, Iht x\sij\\ is thv pruju^-t nn^mtnt 
furmula for the ^orri latum ^.M-ft^^^^nt Iht ^^rrrelation ^utlfi^itnt 
IS the mean of tht sil \A prudu^-N \>\ ifiJ^ird >tt^fis K>f Ihi li^u 
variables 



Zx - Z - scores lor <ill t 
Zy = Z » scores for all v 
11 = number ol subjects 

PROFILE 

An analytic graphic presentation of a pupil s on^s on a tesl bat- 
tery, scorejj on parts of a given test m^rks in s^^veral si-houl sub» 
jeets, ralin*>^i on several perMmahlv variables, etc 
EX- 
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RANDOM SAMPLING 

The basic characlenstic of random sampling is that all members of 
the population have an equal and independent chance iif being 
included in the f^:7iple That i^;, for evtr^^ pan v>l elements x'and 
>, x's chance of being selected equals y ^ chance, ^nd the selection 
of X in no way affects y's probability of jjeki^tion 
BX— Mary, Joe and Sally an' in Ms Biown s class She dtM^di^. to 
choose 2 of them to do an experiment She puts all of their n^cs 
m a hat. They all have a;i equal chance t^> be chosen and il one is 
chosen this does not affect the chames ijf the others being chosen 

RANGE 

The difference between the highest and lowest scores in a giwn 
distribution of scores 

bX— If the highest score in a distribution <»s 74 vind the lowest as 
30, the range would be R =^ 74 - 3(> - 44 

RANKING 

The process of ordering the constituen s of o gr^J^P it^ terms of 

some dimension Rank numbers mdica e the relative position of 
the constituents 

I^X— Scores on a reading achk'vi*menl l< si 

S63 61 6 0 6 0 e>| 

Rl 2 4 4 4 T 7^ 

" MING 

A direct appraisal kAa dimen^jun m tirni> ^^f ^mit Jesiriptu^ stale 
or verbal cLissificati^n scheme 

EX — ChiUiren are rated bv their teacher for their disruptive be- 
havior 1 " very dl^ruptlv^e. 2 - awra>;e, 3 - *^uiei 

RATIO SCALE 

The highest level of mtasurtmenl js prt vdK^ b> a ratu.r stale In 
addition to having equal intervals, a ratio sc.ik" nu^asures fn>m a 
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meaningful zeio Most physjCa) measures have a meamngf:;! zero 
The scale used in edutJh.-T* mtfasuromonb ate soldum of thiskvd 
of measurement. 

Ex— US(ng a fatio scale wo can s^y thai John 48 itKhos tall Ralph 
IS 45 mches tall and P^ul is 44 inchtfs tall hut using an intorva) 
scale we are only able to say that John is 3 inches taitor than Ralph, 
who IS one inch taller than Paul Nut only can wo say that the 
differen<:e between 60 and 90 pounds is the same as tht' difference 
between 90 pounds and 120 pounds, but we can say that 12(1 
pounds IS twice as heavy as 60 poundi^ We can do thi^ because 
zero weight is an actual possibility 

RAW SCORE 

The first quantitative untreated result obtained m sconng a test 
EX— Bill cot 98% on vocabulary test 

JilTgot S3% on vocabulary lest 

Tony got 7$% on vocabulary (e^t 

READING GRADE 

A type of ''norm" score derived from standardized tests that states 
a pupil's ability to read in terms of grade equivalents Heading 
grade means the school grade whose average performance is niu^t 
like that of the pupil in question. By interpolation, the readmg 
grade be fractional As with reading age, reading grade refers only 
to a given standardized test 

EX— Ann received a b.3 on ihe Gak-s-MacCmitieb Test She is per^ 
forming at sixth grade^ thr^ month leve) of achievement. 

RELIABILITY ' 

The extent lo which a measuring device is constant in measunng 
whatever it measiires. 

EX — Will Greg receive approximately th'* same score on the Read- 
ing Achievement te^t if he takes it a secund time two weeks after 
he took it the first time? 

RESEARCH PROBLEM 

A question concerning the relationships existing* between set^ of 
events (vanablcs) in education. Resear*-*^ is o>nductwi jn r^nli^r lo 
hnd answers to thc^e questions. One of the most fruitful sources 
for the beginning researcher is his experience as an educational 
practitioner. Deasions must be made datly about the pri>bable ef- 
fects of educational experience on pupil beluvior 
HX— What IS the effectiveness of us»ng verbal instructions com- 
part to written un^s' 

RETEST (also called a PosMesO 
A test re administered at *he end of a period of instruction or otht'r 
activity^ the result of which is to be compared withaneailier.admin- 
istration of a test. 

ax — A list of spelling words are given at the beginning of the week 
to determine whi ^ words a child needs to learn After working 
on the words all wt'ek a test is given Friday (o find U (tiepupifs 
learn the words The test on Priday wmild be considered a retest 
or post-t?st 

RHO fQ) 

The rank' difference measure of correlation Individuals are as- 
signed ranks with respect io each of two variables^ and Un eaiti 
individual the difference (d) in rank (s determined. These differ- 
ences are squared an^ summed for alt cases and substitution is 
made in the folk^wing formula 

SAMPLE 

A sample is a portion of a population * 
HX—TttechitdreninMs SmUh'sclassisa-. iple of the population 
of sixth grade students in that district Readin^^ Group A is Ms 
Smith's class is a sample of her sixth grade class. 



SCALING 

Measurement in terms of defined and precise units that represent 
giveii amounts or degrees of some dimension. Scale numbers in- 
dicate the number of unitb ^d hence the amount or degree of the 
dimension Scale numbers refer to a fixed point of reference* usu- 
ally a zero. 

EX — Rate your agreement w ith this statement un a scale of Mo 5 

1 ^ strongly agree 

2 = agree 

3 - undecided 

4 = disagree 

5 = strongly disagree 



SCORING 

A process of assigning a score (usually a number or letter symbol) 
to a test or pupil product. rOra test^ thisisoftendont*bycompanryg 
a paper with the keV' marking !he questions answered correctly 
and adding up the total. 
EX — Bill got 9 words right Score = 9 

Judy got 15 words nght Score = 15 

Ruth got 12 words right Score = 12 



SELF-EVALUATION 

Any of many concepts and procedures concerned with an individ- 
ual observing and fudging his own performance, achievementn or 
adjustment. 

EX — Cbopersmith Self'Esteem Inventory 
STANDARD DEVIATION 

An index of variation in a group of mesurcS It represents the 
square root ot the mean of the squared deviations of the individual 
measures. 

d' = differena' between score and mean 
n =^ number of subjects 

STANDARD SCORE (z score) 

A general term fefernryg to any of a number of scores that indicate 
how many standard deviations a measurement is above or below 
Ihe mean, ft is found by determining the difference between the 
raw score (X) and th- mean (X) and dividing by the standard de- 
viation {S) 

^ ^'^ 

tx^ 2 = — 

X = Bills score 
X ^ Class average 

X = Standard deviation (etjuation needed) 
STANDARDIZED TESTS 

TestS/ usually published^ which have been preadmiiustered to a 
pupulation of known charactensttcs and yield scores in terms of 
this population Tlus pOpulatK)n is selected so as to be a repre* 
sentative samp'e of the total population for which the test is de- 
signed 

EX— Stan ford -Bine t Intelligence Test. Metropolitan Pnmarv 
Achievement Test, Gmn Reading Achievement Test 

STANINE 

Any one of nine intervals on *^ -icale uf standt^rd scort-s The "stan* 
me" {abbn^'viation rut standard -nine) 'nalc spans the normal curve 
in nine intervals of si/e e<|ual to one half of a standard score The 
stanine intervals have values from 1 to 9 and then^tddle interval 
5, extends from standard scon* - V4 to + */4 
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STATISTICAL PROCEDURES 

Basic methods of handling quantitative infoniiatior> in sudi a ivay 
as to make tliat infoimation meaningful Tliese procedures li^ve 
Iwo prindpal advantages for tlie researcher First, thoy enable him/ 
Ker to describe and summanze his observations Such techniques 
are called descriptive statistics. Seconds they hejp him/her determine 
how reliably (s)he can infer thai phenomena observed in a limited 
^roup^ a sample, will also occur in the unobserved larger population 
of concern, from which the sample was drawn. In other words, 
how well (s)he can employ inductive reawmng to infer iKat wKat 
(s)he observes ^n the part will beobserve^J in the whole. For prob- 
lems of this nature (s)he will need to employ ittfercnttal stattstics 
EX — Finding the mean score — descriptive statt^ttcs Finding if there 
is significant tj^xiieTences-tnferentja! statistics 

STATISTIC(S) 

Any derived quantity obtained from a set of raw scores or meas- 
ures 

EX — N, mean, standard deviation, medianjr m<>dt*. quartjie devia. 
hon^ correlation coefficient 



TESTS 

Any of a great number of procedures jn which m d iv id nals respond 
to a common stimulation in comparable ways and which yield a 



measure of the individuals with respect to one or more dimensions 
EX— Achievement testji, Personahty tests, Spt^llmg tests. Perform- 
ance tests. Ability tests 

VALIDATION 

The process of establishing on the basLs of empirical datii the va- 
hdity of a test, usually a standardized one, by comparing its re<4ilts 
with one or more cntena Typically involves, a^ a minimum item 
analysis, correlation of results with other test sc4>res, analysis nf 
distribuhons of scores, and determination of n'liabilitv 
BX — See test manual or Mental Measurement Yearboolt by Buros 
to find out about a test validation 

VALIDITY 

The extent to which an instrument measures what it is supposed 
to measure 

HX — A test measures a puptl's reading c^>mprehension not sj/e of 
vocabulary orgtfneral knowledge 

VARIABLE 

A concept that can take on different vaiues 
EX— 'It can vary within an individual intm one time ttr druither^ 
between individuals at the same time, between the jverages for 
groupSir and so on. Social class, sex, motivation, intelligence quo- 
tient, and spelling test scores are other examples of variables Ed- 
ucational researchers are interested m determining how such 
variables are related to each other 

VARIANCE 

The mean of the squared deviation svores 



X ' X = difference between score and mc^an 
N ^ number of subjects 
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